00000001:02000400:1.0F:1787856921.104082:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_hostid 00000001:02000400:1.0:1787856941.586842:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787856943.805956:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 770 MB/s 00000001:01000000:2.0:1787856944.058407:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 663 MB/s 00000001:01000000:3.0F:1787856944.307777:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4571 MB/s 00000020:02000000:0.0F:1787856945.226203:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_81_g80478ec 00000400:02000000:3.0:1787856946.551624:0:3292:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.129@tcp [8/256/0/180] 00008000:02000000:3.0:1787856950.720502:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787857001.523329:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787857010.962527:0:5816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787857010.962532:0:5816:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787857010.962641:0:5816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c5e2283d 00000080:02000400:0.0:1787857010.962654:0:5816:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787857010.970101:0:5816:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787857010.970115:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787857010.970156:0:5816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e5bb52af) 00000020:00000080:0.0:1787857010.970177:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787857011.030460:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787857011.031066:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787857011.088561:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787857011.088602:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787857011.088993:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787857011.089050:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787857011.089072:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787857011.089587:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787857011.089596:0:5816:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787857011.089607:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe492 00000020:01000004:2.0:1787857011.089615:0:5816:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787857011.089619:0:5816:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787857011.090004:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c5e2283d from MGS 00000020:01000004:2.0:1787857011.090011:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787857011.090032:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b75fbd20) 00000020:00000080:2.0:1787857011.090047:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787857011.090155:0:5816:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e2283d from MGS, refs=2 00080000:01000000:2.0:1787857011.090162:0:5816:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787857011.090168:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe4a0 00000100:00100000:2.0:1787857011.090337:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787857011.090472:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787857011.090478:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787857011.091351:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787857011.091359:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787857011.092542:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857011.093187:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787857011.093194:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787857011.094152:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787857011.094160:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787857011.095027:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787857011.095041:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787857011.103109:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857011.103119:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857011.103122:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857011.103602:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857011.103604:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857011.103606:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857011.104376:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787857011.108011:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787857011.353712:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2391 MB/s 00000001:01000000:0.0:1787857011.603735:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3087 MB/s 00000001:01000000:1.0:1787857011.854117:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:1.0:1787857012.107541:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 703 MB/s 00080000:10000000:2.0:1787857012.115190:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787857012.135618:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787857012.135634:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787857012.135637:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787857012.147274:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787857012.147402:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787857012.147466:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787857012.147723:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787857012.147750:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787857012.148086:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857012.148236:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787857012.148243:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787857012.152464:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787857012.152578:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787857012.157242:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787857012.157258:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787857012.158818:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787857012.158842:0:5816:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.129@tcp' 00000020:01000004:2.0:1787857012.158844:0:5816:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787857012.158943:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.129@tcp (typ=mgc) 00000020:00000080:2.0:1787857012.158957:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.129@tcp (000000005a97e55d) 00000020:00000080:2.0:1787857012.158974:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787857012.159054:0:5816:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ac189ab8@MGC192.168.204.129@tcp: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1787857012.159266:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.129@tcp-0 is initialized 00000040:01000000:2.0:1787857012.159274:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787857012.161219:0:5832:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787857012.161411:0:5833:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787857012.163223:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.129@tcp (uuid 77122e39-57f8-4b24-9fe4-5b00eda54f16) 00000020:00000080:2.0:1787857012.163249:0:5816:0:(genops.c:1385:class_connect()) connect: client 77122e39-57f8-4b24-9fe4-5b00eda54f16, cookie 0xf326646fe3bbe4ae 00000100:00080000:2.0:1787857012.163262:0:5816:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787857012.163268:0:5816:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import 00000000ac189ab8 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857012.163300:0:5816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0d8096a x1874703885009024/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787857012.163329:0:5816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 77122e39-57f8-4b24-9fe4-5b00eda54f16->MGS 00000020:01000004:2.0:1787857012.163355:0:5816:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787857012.163359:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787857012.163379:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000006a65a19b) 00000020:00000080:2.0:1787857012.163390:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787857012.163698:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77122e39-57f8-4b24-9fe4-5b00eda54f16:3308:1874703885009024:0@lo:250: 00000100:00100000:3.0:1787857012.163802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857012.163882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009024 00000100:00100000:3.0:1787857012.163889:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009024 00000100:00100000:3.0:1787857012.163927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857012.163933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035e01fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1874703885009024:12345-0@lo:250: 00010000:00080000:3.0:1787857012.163953:0:5829:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 77122e39-57f8-4b24-9fe4-5b00eda54f16@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1787857012.163974:0:5829:0:(genops.c:1385:class_connect()) connect: client 77122e39-57f8-4b24-9fe4-5b00eda54f16, cookie 0xf326646fe3bbe4bc 00000100:00080000:3.0:1787857012.166855:0:5829:0:(import.c:65:import_set_state_nolock()) 00000000e36e710a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857012.166970:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035e01fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:3308:x1874703885009024:12345-0@lo:250: Request processed in 3033us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.166981:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857012.167055:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787857012.167065:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.129@tcp: connect to target with instance 0 00000100:00080000:3.0:1787857012.167072:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787857012.167632:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787857012.167636:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000ac189ab8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787857012.167639:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787857012.167654:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787857012.167676:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77122e39-57f8-4b24-9fe4-5b00eda54f16:3308:1874703885009024:0@lo:250: 00010000:00010000:0.0:1787857012.168710:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857012.194520:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857012.195172:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787857012.195179:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787857012.200860:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787857012.200890:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787857012.201349:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787857012.201355:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787857012.205374:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857012.206013:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787857012.206020:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787857012.213183:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787857012.213200:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787857012.296928:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857012.297135:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787857012.297143:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787857012.300697:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787857012.300714:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787857012.302066:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857012.302259:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787857012.302264:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787857012.303232:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787857012.303241:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787857012.305248:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857012.305932:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787857012.305939:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787857012.307237:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787857012.307249:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787857012.309013:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857012.309197:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787857012.309203:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787857012.310136:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787857012.310144:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787857012.357051:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857012.357253:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787857012.357260:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787857012.360755:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787857012.360775:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787857012.368518:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787857012.368535:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787857012.374967:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787857012.375004:0:5816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787857012.375010:0:5816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787857012.375169:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787857012.375210:0:5816:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787857012.375215:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787857012.375217:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787857012.375218:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857012.375219:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857012.375220:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857012.375221:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857012.375222:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787857012.375223:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787857012.375225:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857012.375226:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857012.375227:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857012.375228:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787857012.375230:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787857012.375232:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787857012.375234:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787857012.375235:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857012.375236:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857012.375242:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857012.375243:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857012.375243:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787857012.375244:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787857012.375245:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857012.375246:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857012.375247:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857012.375247:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787857012.375277:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787857012.375295:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e24ac51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009152:0@lo:253: 00000100:00100000:3.0:1787857012.375374:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857012.375492:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3c1008a going to sleep for 11 seconds 00000100:00100000:0.0:1787857012.386159:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009152 00000100:00100000:0.0:1787857012.386182:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009152 00000100:00100000:0.0:1787857012.386298:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857012.386308:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb02d9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:5816:x1874703885009152:12345-0@lo:253: 20000000:01000000:0.0:1787857012.386360:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787857012.386365:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787857012.386844:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787857012.387064:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787857012.387348:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857012.388327:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787857012.392860:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787857012.392878:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787857012.392885:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787857012.392888:0:5831:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787857012.392907:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787857012.393150:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857012.393406:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787857012.393420:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787857012.394681:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787857012.394833:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787857012.394903:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787857012.395036:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787857012.395046:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787857012.395091:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787857012.395099:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787857012.395127:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787857012.395133:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787857012.395160:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787857012.395204:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787857012.395236:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787857012.395242:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787857012.395266:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857012.399106:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787857012.399139:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787857012.399223:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787857012.399260:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787857012.399323:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787857012.399343:0:5831:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787857012.399465:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787857012.400931:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787857012.401064:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787857012.401107:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787857012.401141:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787857012.401159:0:5831:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787857012.401287:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787857012.401297:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787857012.401328:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787857012.401394:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787857012.401583:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787857012.402938:0:5831:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787857012.402950:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787857012.404253:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787857012.404851:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787857012.404893:0:5831:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.129@tcp for mdt 20000000:01000000:2.0:1787857012.404896:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787857012.404933:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787857012.404942:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787857012.404973:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787857012.404980:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:2.0:1787857012.405039:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787857012.405049:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787857012.405081:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787857012.405112:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787857012.405184:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787857012.405187:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787857012.405191:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787857012.405203:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787857012.405205:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787857012.405234:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787857012.405237:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787857012.409943:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787857012.415426:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787857012.415499:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787857012.415538:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787857012.415553:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787857012.415556:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787857012.418192:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787857012.418571:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787857012.418639:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787857012.418752:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787857012.418768:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787857012.418772:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787857012.418779:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787857012.418781:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787857012.418787:0:5831:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787857012.418795:0:5831:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787857012.419454:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787857012.422635:0:5831:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787857012.434432:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787857012.434500:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787857012.434578:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787857012.434601:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787857012.434620:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.434635:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.434645:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.434652:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436368:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436385:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436412:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000043ff0a2d already unused, calling callback (00000000e5f0725f) 00010000:00010000:3.0:1787857012.436416:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436424:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436437:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436444:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.436450:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787857012.436484:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787857012.688908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb02d9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:5816:x1874703885009152:12345-0@lo:253: Request processed in 302595us (313527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857012.688929:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857012.689035:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e24ac51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009152:0@lo:253: 10000000:01000000:0.0:1787857012.689051:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787857012.689055:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787857012.689057:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857012.689059:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857012.689060:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787857012.689062:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857012.689063:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857012.689064:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857012.689066:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857012.689150:0:5816:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787857012.689152:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857012.689153:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787857012.689181:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c5e2283d from lustre-MDT0000 10000000:01000000:0.0:1787857012.689207:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787857012.689210:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787857012.689215:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fd942e119d0 10000000:01000000:0.0:1787857012.689220:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787857012.689229:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fd942e119d0 from 1 10000000:01000000:0.0:1787857012.689232:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787857012.689269:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.689279:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.689287:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857012.689307:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009280:0@lo:101: 00000100:00100000:0.0:1787857012.689343:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.689553:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:1.0:1787857012.689805:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009280 00000100:00100000:1.0:1787857012.689812:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009280 00000100:00100000:1.0:1787857012.689913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787857012.689922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000574c1d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:5816:x1874703885009280:12345-0@lo:101: 00010000:00010000:1.0:1787857012.689936:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857012.689954:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008375bbe3/0xf326646fe3bbe4d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe4ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.689976:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008375bbe3/0xf326646fe3bbe4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.689985:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008375bbe3/0xf326646fe3bbe4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.689993:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008375bbe3, rc 0) 00000100:00100000:1.0:1787857012.690054:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000574c1d6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5816:x1874703885009280:12345-0@lo:101: Request processed in 133us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.690061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857012.690132:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009280:0@lo:101: 00010000:00010000:0.0:1787857012.690144:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.690152:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857012.690208:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009408:0@lo:501: 00000100:00100000:0.0:1787857012.690235:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.690420:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:3.0:1787857012.690541:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009408 00000100:00100000:3.0:1787857012.690546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009408 00000100:00100000:3.0:1787857012.690570:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857012.690576:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce4952c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5816:x1874703885009408:12345-0@lo:501: 00000100:00100000:3.0:1787857012.690889:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce4952c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5816:x1874703885009408:12345-0@lo:501: Request processed in 313us (652us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857012.690896:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857012.690970:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009408:0@lo:501: 10000000:01000000:0.0:1787857012.690998:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787857012.691015:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691024:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000ba03695c/0xf326646fe3bbe4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857012.691031:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd96116a000 10000000:01000000:0.0:1787857012.691036:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787857012.691040:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fd96116a000 10000000:01000000:0.0:1787857012.691042:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787857012.691045:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fd96116a000 from 1 10000000:01000000:0.0:1787857012.691048:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787857012.691065:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691082:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691090:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857012.691102:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009536:0@lo:101: 00000100:00100000:0.0:1787857012.691128:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.691149:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:1.0:1787857012.691316:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009536 00000100:00100000:1.0:1787857012.691320:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009536 00000100:00100000:1.0:1787857012.691349:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787857012.691355:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d70d1ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5816:x1874703885009536:12345-0@lo:101: 00010000:00010000:1.0:1787857012.691364:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857012.691373:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa94f587/0xf326646fe3bbe4df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe4d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.691388:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa94f587/0xf326646fe3bbe4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe4d8 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.691471:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa94f587/0xf326646fe3bbe4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe4d8 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857012.691478:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa94f587, rc 0) 00000100:00100000:1.0:1787857012.691577:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d70d1ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+7:5816:x1874703885009536:12345-0@lo:101: Request processed in 222us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857012.691583:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857012.691722:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009536:0@lo:101: 00010000:00010000:0.0:1787857012.691733:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691746:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857012.691759:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787857012.691763:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691769:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000319ab5ec/0xf326646fe3bbe4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857012.691776:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787857012.691779:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787857012.691783:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fd96116a000 10000000:01000000:0.0:1787857012.691786:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787857012.691789:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787857012.691791:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857012.691803:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691810:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.691817:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857012.691826:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009664:0@lo:101: 00000100:00100000:0.0:1787857012.691851:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.691885:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:3.0:1787857012.691955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009664 00000100:00100000:3.0:1787857012.691960:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009664 00000100:00100000:3.0:1787857012.691978:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857012.691983:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f654e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+7:5816:x1874703885009664:12345-0@lo:101: 00010000:00010000:3.0:1787857012.691998:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857012.692005:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe4e6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.692018:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.692026:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043ff0a2d/0xf326646fe3bbe4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857012.692032:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043ff0a2d, rc 0) 00000100:00100000:0.0:1787857012.692158:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009664:0@lo:101: 00010000:00010000:0.0:1787857012.692235:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857012.692243:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857012.692286:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009792:0@lo:501: 00000100:00100000:0.0:1787857012.692312:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.692320:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:3.0:1787857012.692353:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f654e5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+8:5816:x1874703885009664:12345-0@lo:101: Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.692359:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857012.692378:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009792 00000100:00100000:3.0:1787857012.692382:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009792 00000100:00100000:3.0:1787857012.692471:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787857012.692478:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009ff92d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+8:5816:x1874703885009792:12345-0@lo:501: 00000100:00100000:3.0:1787857012.692818:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009ff92d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5816:x1874703885009792:12345-0@lo:501: Request processed in 340us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.692825:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857012.692903:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009792:0@lo:501: 00000100:00100000:0.0:1787857012.692929:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009920:0@lo:503: 00000100:00100000:0.0:1787857012.692967:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857012.692992:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024759d1d going to sleep for 11 seconds 00000100:00100000:3.0:1787857012.693042:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885009920 00000100:00100000:3.0:1787857012.693046:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885009920 00000100:00100000:3.0:1787857012.693064:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787857012.693145:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a3e30e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5816:x1874703885009920:12345-0@lo:503: 00000100:00100000:3.0:1787857012.693352:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a3e30e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5816:x1874703885009920:12345-0@lo:503: Request processed in 283us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.693361:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787857012.693554:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885009920:0@lo:503: 00000100:00100000:0.0:1787857012.694013:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5859:1874703885010048:0@lo:502: 00000100:00100000:0.0:1787857012.694055:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857012.694246:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010048 00000100:00100000:3.0:1787857012.694252:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010048 00000100:00100000:3.0:1787857012.694290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787857012.694297:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc070150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5859:x1874703885010048:12345-0@lo:502: 00000100:00100000:0.0:1787857012.694482:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2172490 going to sleep for 11 seconds 00000100:00100000:3.0:1787857012.694756:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc070150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5859:x1874703885010048:12345-0@lo:502: Request processed in 459us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857012.694763:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787857012.695054:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5859:1874703885010048:0@lo:502: 00000020:01000000:0.0:1787857012.695155:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857012.695232:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857012.695235:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787857012.695241:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787857012.695244:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787857012.695256:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003329ef9c) 00000020:00000080:0.0:1787857012.695273:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787857012.695287:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787857012.695356:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787857012.695363:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe4fb 00000020:00000080:0.0:1787857012.695725:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787857012.695730:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857012.695733:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857012.695734:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787857012.695737:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857012.695740:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857012.695742:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787857012.695745:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787857012.695750:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000015bd477f) 00000020:00000080:0.0:1787857012.695759:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787857012.695762:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787857012.695764:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787857012.695767:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787857012.695772:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787857012.695810:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e2283d from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787857012.695820:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d096ec2c) 00000020:00000080:0.0:1787857012.695826:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787857012.695893:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787857012.695898:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbe510 00000020:00000080:0.0:1787857012.695978:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787857012.695982:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787857012.695985:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf326646fe3bbe517 00080000:01000000:0.0:1787857012.695989:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787857012.695992:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe51e 00080000:10000000:0.0:1787857012.696529:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787857012.696927:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787857012.701372:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787857012.810300:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787857012.811095:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787857012.816307:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787857012.816604:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787857012.956655:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000014ef2bb2) 00000020:00000080:1.0:1787857012.956707:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787857012.956815:0:5859:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787857012.956824:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe52c 00000020:00000080:1.0:1787857012.957042:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787857012.966632:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857013.050111:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857013.112943:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857013.147355:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857013.183481:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1787857013.191839:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787857013.213620:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787857013.244902:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf326646fe3bbe533 00000020:00000080:0.0:1787857013.245357:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787857013.245368:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857013.245373:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857013.245381:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787857013.245384:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857013.245389:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857013.245390:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787857013.245393:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787857013.245394:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787857013.245397:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857013.245399:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857013.245400:0:5859:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787857013.245402:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857013.245406:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857013.245407:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787857013.245411:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787857013.245447:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787857013.245500:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5859:1874703885010176:0@lo:502: 00000100:00100000:0.0:1787857013.245655:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857013.245751:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e0bc47f going to sleep for 11 seconds 00000100:00100000:2.0:1787857013.245861:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010176 00000100:00100000:2.0:1787857013.245868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010176 00000100:00100000:2.0:1787857013.245913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787857013.245921:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2ee929b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5859:x1874703885010176:12345-0@lo:502: 00000100:00100000:2.0:1787857013.246357:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2ee929b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5859:x1874703885010176:12345-0@lo:502: Request processed in 435us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857013.246365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857013.246462:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5859:1874703885010176:0@lo:502: 00000020:01000000:0.0:1787857013.246491:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857013.246497:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857013.246499:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787857013.246502:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787857013.246833:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787857013.246862:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787857013.246884:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.246894:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000926cf945/0xf326646fe3bbe4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857013.246901:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96116a000 from 1 10000000:01000000:2.0:1787857013.246911:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787857013.246939:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.246946:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.246954:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857013.246967:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010304:0@lo:101: 00000100:00100000:2.0:1787857013.246999:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857013.247027:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ffb757d going to sleep for 11 seconds 00000100:00100000:2.0:1787857013.247045:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010304 00000100:00100000:2.0:1787857013.247050:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010304 00000100:00100000:2.0:1787857013.247074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787857013.247081:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a587ce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:5816:x1874703885010304:12345-0@lo:101: 00010000:00010000:2.0:1787857013.247091:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857013.247103:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe53a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.247123:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.247132:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.247139:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083b62e84, rc 0) 00000100:00100000:2.0:1787857013.247180:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a587ce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:5816:x1874703885010304:12345-0@lo:101: Request processed in 99us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857013.247195:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787857013.247231:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010304:0@lo:101: 00010000:00010000:2.0:1787857013.247243:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.247250:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857013.247994:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010432:0@lo:256: 00000100:00100000:2.0:1787857013.248036:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857013.248055:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ffb757d going to sleep for 11 seconds 00000100:00100000:2.0:1787857013.248075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010432 00000100:00100000:2.0:1787857013.248080:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010432 00000100:00100000:2.0:1787857013.248104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787857013.248110:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000454dc2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:5816:x1874703885010432:12345-0@lo:256: 20000000:01000000:2.0:1787857013.248125:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787857013.248130:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787857013.248330:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000454dc2c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:5816:x1874703885010432:12345-0@lo:256: Request processed in 219us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857013.248337:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787857013.248375:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010432:0@lo:256: 10000000:01000000:2.0:1787857013.249062:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787857013.249080:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.249089:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857013.249102:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96116a000 from 1 10000000:01000000:2.0:1787857013.249104:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857013.249125:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.249132:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857013.249140:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857013.249311:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010560:0@lo:101: 00000100:00100000:2.0:1787857013.249353:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857013.249416:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ffb757d going to sleep for 11 seconds 00000100:00100000:0.0:1787857013.249510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010560 00000100:00100000:0.0:1787857013.249517:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010560 00000100:00100000:0.0:1787857013.249653:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857013.249687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f56d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:5816:x1874703885010560:12345-0@lo:101: 00010000:00010000:0.0:1787857013.249698:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857013.249711:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe548 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.249732:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.249749:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.249756:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1ff0fc5, rc 0) 00000100:00100000:0.0:1787857013.249789:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f56d9965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010560:12345-0@lo:101: Request processed in 130us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857013.249796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787857013.249880:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0d8096a pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010560:0@lo:101: 00010000:00010000:1.0:1787857013.249892:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.249910:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857013.249958:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010688:0@lo:501: 00000100:00100000:1.0:1787857013.249984:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.250012:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e0cf28e going to sleep for 11 seconds 00000100:00100000:0.0:1787857013.250059:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010688 00000100:00100000:0.0:1787857013.250063:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010688 00000100:00100000:0.0:1787857013.250081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787857013.250085:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065794fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010688:12345-0@lo:501: 00000100:00100000:0.0:1787857013.250788:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065794fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010688:12345-0@lo:501: Request processed in 702us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857013.250796:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857013.250903:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010688:0@lo:501: 00000100:00100000:1.0:1787857013.250935:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010816:0@lo:503: 00000100:00100000:1.0:1787857013.250972:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.251001:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e0cf28e going to sleep for 11 seconds 00000100:00100000:0.0:1787857013.251048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010816 00000100:00100000:0.0:1787857013.251052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010816 00000100:00100000:0.0:1787857013.251070:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857013.251076:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077b88bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010816:12345-0@lo:503: 00000040:00080000:0.0:1787857013.251106:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787857013.251147:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077b88bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010816:12345-0@lo:503: Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857013.251236:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010816:0@lo:503: 00000040:00080000:1.0:1787857013.251952:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787857013.252005:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787857013.252022:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857013.252034:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.252044:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857013.252079:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787857013.252081:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd96116a000 10000000:01000000:1.0:1787857013.252084:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd96116a000 10000000:01000000:1.0:1787857013.252087:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787857013.252093:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96116a000 from 1 10000000:01000000:1.0:1787857013.252095:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857013.252124:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.252131:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.252139:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857013.252153:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010944:0@lo:101: 00000100:00100000:1.0:1787857013.252315:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.252329:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f863451 going to sleep for 11 seconds 00000100:00100000:0.0:1787857013.252446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857013.252480:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885010944 00000100:00100000:0.0:1787857013.252485:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885010944 00000100:00100000:0.0:1787857013.252508:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787857013.252514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc948ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885010944:12345-0@lo:101: 00010000:00010000:0.0:1787857013.252534:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857013.252606:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039712318/0xf326646fe3bbe55d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe556 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.252629:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039712318/0xf326646fe3bbe55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.252639:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039712318/0xf326646fe3bbe55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.252647:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039712318, rc 0) 00000100:00100000:0.0:1787857013.252707:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc948ca1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885010944:12345-0@lo:101: Request processed in 193us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857013.252714:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857013.252874:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885010944:0@lo:101: 00010000:00010000:1.0:1787857013.252887:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.252894:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857013.252937:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011072:0@lo:501: 00000100:00100000:1.0:1787857013.252963:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.252994:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f863451 going to sleep for 11 seconds 00000100:00100000:3.0:1787857013.253044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011072 00000100:00100000:3.0:1787857013.253048:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011072 00000100:00100000:3.0:1787857013.253085:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787857013.253090:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5bd686a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885011072:12345-0@lo:501: 00000100:00100000:3.0:1787857013.253373:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5bd686a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885011072:12345-0@lo:501: Request processed in 282us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.253380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857013.253482:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011072:0@lo:501: 00000100:00100000:1.0:1787857013.253507:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011200:0@lo:503: 00000100:00100000:1.0:1787857013.253542:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.253630:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f863451 going to sleep for 11 seconds 00000100:00100000:3.0:1787857013.253684:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011200 00000100:00100000:3.0:1787857013.253688:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011200 00000100:00100000:3.0:1787857013.253711:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787857013.253716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000880f359f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885011200:12345-0@lo:503: 00000100:00100000:3.0:1787857013.254004:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000880f359f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885011200:12345-0@lo:503: Request processed in 288us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.254010:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787857013.254137:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13af671 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011200:0@lo:503: 00000100:00100000:0.0:1787857013.254772:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5864:1874703885011328:0@lo:502: 00000100:00100000:0.0:1787857013.254820:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857013.254844:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a086a25b going to sleep for 11 seconds 00000100:00100000:3.0:1787857013.254902:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011328 00000100:00100000:3.0:1787857013.254907:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011328 00000100:00100000:3.0:1787857013.254977:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787857013.254984:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e0bf0b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5864:x1874703885011328:12345-0@lo:502: 00000100:00100000:3.0:1787857013.255339:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e0bf0b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5864:x1874703885011328:12345-0@lo:502: Request processed in 355us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.255345:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857013.255427:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5864:1874703885011328:0@lo:502: 00000020:01000004:0.0:1787857013.255484:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787857013.255509:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b39604a6) 00000020:00000080:0.0:1787857013.255529:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787857013.255613:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e2283d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787857013.255616:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c5e2283d from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787857013.255619:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c5e2283d 4 00010000:00080000:0.0:1787857013.255647:0:5864:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e1ff784@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1787857013.257886:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787857013.258122:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787857013.258232:0:5864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787857013.258244:0:5864:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf326646fe3bbe56b 00000100:00080000:0.0:1787857013.258254:0:5864:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787857013.258259:0:5864:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e1ff784 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857013.258292:0:5864:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003ab7a9a0 x1874703885011456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787857013.258321:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787857013.258492:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885011456:0@lo:38: 00000100:00100000:3.0:1787857013.258572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857013.258820:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011456 00000100:00100000:0.0:1787857013.258827:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011456 00000100:00100000:0.0:1787857013.258867:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857013.258874:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059a2476b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885011456:12345-0@lo:38: 00000100:00100000:0.0:1787857013.258929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059a2476b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885011456:12345-0@lo:38: Request processed in 55us (357us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787857013.258936:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857013.259143:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787857013.259151:0:3308:0:(import.c:65:import_set_state_nolock()) 000000005e1ff784 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787857013.259165:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787857013.259169:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ab7a9a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885011456:0@lo:38: 00000100:00100000:0.0:1787857013.259960:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9d517fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5864:1874703885011584:0@lo:502: 00000100:00100000:0.0:1787857013.260020:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857013.260133:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ff67c6 going to sleep for 11 seconds 00000100:00100000:2.0:1787857013.260197:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011584 00000100:00100000:2.0:1787857013.260203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011584 00000100:00100000:2.0:1787857013.260246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787857013.260254:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000389ba0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5864:x1874703885011584:12345-0@lo:502: 00000100:00100000:2.0:1787857013.260812:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000389ba0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5864:x1874703885011584:12345-0@lo:502: Request processed in 558us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857013.260819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787857013.260880:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9d517fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:5864:1874703885011584:0@lo:502: 00000040:00080000:2.0:1787857013.260908:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787857013.261741:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787857013.261765:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857013.261783:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857013.261794:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 00000000ccfb8416/0xf326646fe3bbe556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787857013.261837:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787857013.261840:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857013.261841:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857013.261842:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857013.261857:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857013.261859:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857013.261860:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857013.261861:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857013.261862:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787857013.261863:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787857013.261865:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857013.261866:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857013.261869:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787857013.261871:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787857013.261872:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857013.261873:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857013.261874:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857013.261875:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857013.261876:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857013.261876:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857013.261877:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857013.261878:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787857013.261879:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787857013.261879:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857013.261880:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857013.261899:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787857013.261912:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b02aeec6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011712:0@lo:253: 00000100:00100000:0.0:1787857013.261960:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857013.261991:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019bf9f83 going to sleep for 11 seconds 00000100:00100000:3.0:1787857013.262062:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011712 00000100:00100000:3.0:1787857013.262068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011712 00000100:00100000:3.0:1787857013.262107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787857013.262114:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d94169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5816:x1874703885011712:12345-0@lo:253: 20000000:01000000:3.0:1787857013.262139:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787857013.262152:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787857013.307481:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787857013.307503:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787857013.307567:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787857013.307572:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787857013.307604:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.307622:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.307631:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.307693:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.307708:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 12 pid: 5831 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857013.307721:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002602ddd9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885011840:0@lo:104: 00000100:00100000:1.0:1787857013.307784:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.307841:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2d266d7 going to sleep for 11 seconds 00000100:00100000:3.0:1787857013.308218:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011840 00000100:00100000:3.0:1787857013.308226:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011840 00000100:00100000:3.0:1787857013.308287:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857013.308295:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e13af671 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885011840:12345-0@lo:104: 00010000:00010000:3.0:1787857013.308307:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308364:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787857013.308375:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e13af671 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885011840:12345-0@lo:104: Request processed in 82us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.308382:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787857013.308402:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857013.308408:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308415:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cefa9b6c already unused, calling callback (00000000a6e1f3c9) 10000000:00010000:3.0:1787857013.308417:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308425:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857013.308430:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857013.308436:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857013.308463:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308470:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857013.308486:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308492:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: 00000000cefa9b6c/0xf326646fe3bbe53a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe541 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.308509:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857013.308510:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857013.308512:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857013.308801:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076b68d77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885011968:0@lo:103: 00000100:00100000:1.0:1787857013.308834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857013.308960:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002602ddd9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885011840:0@lo:104: 00010000:00010000:1.0:1787857013.308979:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857013.309494:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885011968 00000100:00100000:3.0:1787857013.309500:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885011968 00010000:00010000:3.0:1787857013.309521:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 13 pid: 5831 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857013.309542:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857013.309620:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbe150de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3310:x1874703885011968:12345-0@lo:103: 00010000:00010000:3.0:1787857013.309633:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857013.309638:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 13 pid: 5831 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309647:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 13 pid: 5831 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309679:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083b62e84/0xf326646fe3bbe541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe53a expref: 13 pid: 5831 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309693:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309701:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787857013.309716:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002144948s 00010000:00010000:3.0:1787857013.309720:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309726:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309732:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309752:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309758:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048ff2c6f already unused, calling callback (00000000e5f0725f) 00010000:00010000:3.0:1787857013.309761:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309768:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309779:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857013.309789:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857013.309829:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbe150de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3310:x1874703885011968:12345-0@lo:103: Request processed in 213us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.309836:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787857013.309918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076b68d77 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885011968:0@lo:103: 00010000:00010000:1.0:1787857013.309950:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.309957:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857013.309973:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000048ff2c6f/0xf326646fe3bbe572 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857013.321067:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d94169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5816:x1874703885011712:12345-0@lo:253: Request processed in 58945us (59098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857013.321084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787857013.322000:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b02aeec6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:5816:1874703885011712:0@lo:253: 10000000:01000000:0.0:1787857013.322017:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787857013.322020:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787857013.322022:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857013.322024:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857013.322025:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857013.322027:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857013.322028:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857013.322029:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857013.322332:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857013.322335:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787857013.322336:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787857013.322338:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857013.322360:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787857013.322380:0:5816:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787857013.330651:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.331419:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857013.331907:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.332362:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857013.332618:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.332894:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857013.334457:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.334757:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857013.335141:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.335482:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857013.335887:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857013.336380:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787857013.415788:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787857013.452338:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787857013.452411:0:5869:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787857013.452416:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787857013.452692:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787857013.468366:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787857013.468876:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787857013.469764:0:5816:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787857013.469777:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787857013.470100:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857013.472893:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787857013.473927:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787857013.473977:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787857013.474387:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787857013.474759:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787857013.479350:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787857013.479935:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787857013.480109:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787857013.480910:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787857013.481078:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787857013.481381:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787857013.481539:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787857013.481785:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787857013.482020:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787857013.482476:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787857013.482764:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787857013.482912:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787857013.483327:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787857013.483481:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787857013.484000:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787857013.484172:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787857013.484497:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787857013.484648:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787857013.484826:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787857013.484983:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787857013.485131:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787857013.485262:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787857013.485413:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787857013.485557:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787857013.485756:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787857013.485915:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787857013.486084:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787857013.486246:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787857013.486407:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787857013.486541:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787857013.487623:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787857013.487905:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787857013.488125:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787857013.512966:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787857013.575205:0:5816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787857013.575240:0:5816:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc032c1db3988 00100000:10000000:0.0:1787857013.575248:0:5816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787857013.575981:0:5816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787857013.575995:0:5816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787857013.576006:0:5816:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787857013.576022:0:5816:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787857013.588816:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787857013.588903:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787857013.588907:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787857014.215850:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857015.240960:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857016.265814:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857017.289653:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857018.311911:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787857018.699994:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787857018.700004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787857018.700007:0:8:0:(import.c:65:import_set_state_nolock()) 000000005e1ff784 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787857018.700020:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e1ff784 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1787857018.700040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000936febb7 x1874703885012224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787857018.700124:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002b635abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885012096:0@lo:400: 00000100:00100000:1.0:1787857018.700230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857018.700332:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000936febb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885012224:0@lo:38: 00000100:00100000:1.0:1787857018.700368:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857018.700412:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012096 00000100:00100000:1.0:1787857018.700421:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012096 00000100:00100000:1.0:1787857018.700461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857018.700470:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da6e7911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3311:x1874703885012096:12345-0@lo:400: 00000100:00100000:1.0:1787857018.700526:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da6e7911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3311:x1874703885012096:12345-0@lo:400: Request processed in 57us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857018.700535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857018.700596:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002b635abc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885012096:0@lo:400: 00000100:00100000:2.0:1787857018.704798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012224 00000100:00100000:2.0:1787857018.704812:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012224 00000100:00100000:2.0:1787857018.704862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857018.704871:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c55107a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874703885012224:12345-0@lo:38: 00010000:00080000:2.0:1787857018.704909:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1787857018.707652:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf326646fe3bbe579 00000004:00100000:2.0:1787857018.707775:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787857018.707919:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000758ac847 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857018.708010:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c55107a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874703885012224:12345-0@lo:38: Request processed in 3138us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857018.708020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787857018.708404:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000936febb7 x1874703885012224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787857018.708423:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787857018.708431:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787857018.708437:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787857018.708439:0:3308:0:(import.c:65:import_set_state_nolock()) 000000005e1ff784 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787857018.708445:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000936febb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885012224:0@lo:38: 00000001:02000400:1.0:1787857018.920700:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787857019.336867:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857020.362541:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857021.383921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787857022.282599:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787857022.282607:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96116a000 from 3 10000000:01000000:2.0:1787857022.282612:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787857022.283740:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.283756:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.283767:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857022.284985:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db961726 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885012352:0@lo:101: 00000100:00100000:3.0:1787857022.285061:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857022.285112:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc420fa8 going to sleep for 11 seconds 00000100:00100000:2.0:1787857022.285443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012352 00000100:00100000:2.0:1787857022.285451:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012352 00000100:00100000:2.0:1787857022.285524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787857022.285533:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000222fd587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5833:x1874703885012352:12345-0@lo:101: 00010000:00010000:2.0:1787857022.285549:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857022.285566:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042b1ab82/0xf326646fe3bbe587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe580 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.285592:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042b1ab82/0xf326646fe3bbe587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.285612:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042b1ab82/0xf326646fe3bbe587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.285621:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042b1ab82, rc 0) 00000100:00100000:2.0:1787857022.285712:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000222fd587 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885012352:12345-0@lo:101: Request processed in 180us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857022.285719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787857022.285791:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db961726 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885012352:0@lo:101: 00010000:00010000:2.0:1787857022.285806:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.285814:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857022.285871:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db961726 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885012480:0@lo:256: 00000100:00100000:2.0:1787857022.285904:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857022.286045:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7be6bdd going to sleep for 11 seconds 00000100:00100000:3.0:1787857022.286107:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012480 00000100:00100000:3.0:1787857022.286111:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012480 00000100:00100000:3.0:1787857022.286144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787857022.286150:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080b15cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885012480:12345-0@lo:256: 20000000:01000000:3.0:1787857022.286163:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787857022.286187:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787857022.286190:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787857022.286266:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080b15cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885012480:12345-0@lo:256: Request processed in 116us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857022.286273:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857022.286389:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db961726 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885012480:0@lo:256: 10000000:01000000:2.0:1787857022.286428:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787857022.286434:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.286441:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: 000000004fb403e1/0xf326646fe3bbe580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857022.408275:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857023.439390:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857023.817771:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000187b37e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885012608:0@lo:400: 00000100:00100000:1.0:1787857023.817872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857023.817931:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012608 00000100:00100000:2.0:1787857023.817941:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012608 00000100:00100000:1.0:1787857023.817960:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc73ebe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885012736:0@lo:400: 00000100:00100000:1.0:1787857023.817991:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857023.818000:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857023.818011:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a13e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3312:x1874703885012608:12345-0@lo:400: 00000100:00100000:2.0:1787857023.818075:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a13e94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3312:x1874703885012608:12345-0@lo:400: Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857023.818083:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857023.818154:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012736 00000100:00100000:0.0:1787857023.818181:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012736 00000100:00100000:0.0:1787857023.818219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857023.818225:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012ad882c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885012736:12345-0@lo:400: 00000100:00100000:0.0:1787857023.818265:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012ad882c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885012736:12345-0@lo:400: Request processed in 41us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857023.818271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787857023.818305:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cc73ebe4 x1874703885012736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857023.818318:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc73ebe4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885012736:0@lo:400: 00000100:00100000:1.0:1787857023.818691:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000187b37e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885012608:0@lo:400: 00000020:00000080:3.0:1787857023.965507:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf3a24110 20000000:00000080:3.0:1787857023.965528:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd946117400 uarg=0000000000000000 20000000:01000000:3.0:1787857023.965563:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787857023.965570:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787857023.965575:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787857023.965859:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787857023.965870:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787857023.974266:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787857023.974510:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787857023.974576:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787857023.977400:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787857023.977445:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787857023.977472:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857023.977493:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857023.977501:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857023.977542:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857023.977558:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 11 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857023.977571:0:6316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006307436d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1874703885012864:0@lo:104: 00000100:00100000:3.0:1787857023.977653:0:6316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857023.977727:0:6316:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e6cd6a4 going to sleep for 11 seconds 00000100:00100000:1.0:1787857023.977762:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012864 00000100:00100000:1.0:1787857023.977770:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012864 00000100:00100000:1.0:1787857023.977819:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787857023.977836:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe24130a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:6316:x1874703885012864:12345-0@lo:104: 00010000:00010000:1.0:1787857023.977861:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857023.977920:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857023.977925:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe24130a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:6316:x1874703885012864:12345-0@lo:104: Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857023.977931:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787857023.978289:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857023.978295:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978303:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000516315de already unused, calling callback (00000000a6e1f3c9) 10000000:00010000:2.0:1787857023.978306:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978314:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857023.978320:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857023.978326:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857023.978379:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978386:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857023.978408:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978414:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe54f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978440:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857023.978442:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857023.978443:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857023.978477:0:6316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006307436d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1874703885012864:0@lo:104: 00010000:00010000:2.0:1787857023.978497:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857023.978569:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4daf089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885012992:0@lo:103: 00000100:00100000:1.0:1787857023.978606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857023.978794:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885012992 00000100:00100000:2.0:1787857023.978799:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885012992 00010000:00010000:2.0:1787857023.978817:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 12 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857023.978903:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857023.978910:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc8b3137 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3310:x1874703885012992:12345-0@lo:103: 00010000:00010000:2.0:1787857023.978921:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857023.978925:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 12 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978934:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 12 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978958:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1ff0fc5/0xf326646fe3bbe54f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe548 expref: 12 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978970:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.978977:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979000:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979007:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979013:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979019:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979025:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000945216c8 already unused, calling callback (00000000e5f0725f) 00010000:00010000:2.0:1787857023.979027:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979034:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979046:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857023.979055:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857023.979093:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc8b3137 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3310:x1874703885012992:12345-0@lo:103: Request processed in 184us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857023.979100:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787857023.979296:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857023.979305:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857023.979310:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000945216c8/0xf326646fe3bbe58e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857023.983196:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4daf089 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885012992:0@lo:103: 00010000:00010000:1.0:1787857024.456124:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857025.482196:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857026.517107:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857027.528147:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857028.552186:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857028.935855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091f3addf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885013248:0@lo:400: 00000100:00100000:1.0:1787857028.935932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857028.935986:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857028.935992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b5268d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885013120:0@lo:400: 00000100:00100000:1.0:1787857028.936019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857028.936083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013248 00000100:00100000:2.0:1787857028.936090:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013248 00000100:00100000:2.0:1787857028.936137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857028.936151:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b051c21e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885013248:12345-0@lo:400: 00000100:00100000:2.0:1787857028.936206:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b051c21e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885013248:12345-0@lo:400: Request processed in 56us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857028.936213:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857028.936240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013120 00000100:00100000:0.0:1787857028.936245:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013120 00000100:00100000:0.0:1787857028.936273:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787857028.936279:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dca8c510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3312:x1874703885013120:12345-0@lo:400: 00000100:00100000:0.0:1787857028.937044:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dca8c510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3312:x1874703885013120:12345-0@lo:400: Request processed in 765us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857028.937053:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857028.940870:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b5268d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885013120:0@lo:400: 00010000:00080000:2.0:1787857028.940899:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000091f3addf x1874703885013248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857028.940913:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091f3addf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885013248:0@lo:400: 10000000:01000000:2.0:1787857029.448891:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857029.448899:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96116a000 from 1 10000000:01000000:2.0:1787857029.448905:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857029.448954:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe595 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857029.448966:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe595 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857029.448977:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe595 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857029.449000:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053bdc4c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013376:0@lo:101: 00000100:00100000:2.0:1787857029.449066:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857029.449121:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfb59bbb going to sleep for 11 seconds 00000100:00100000:3.0:1787857029.449278:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013376 00000100:00100000:3.0:1787857029.449285:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013376 00000100:00100000:3.0:1787857029.449335:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857029.449342:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef00ae53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:5833:x1874703885013376:12345-0@lo:101: 00010000:00010000:3.0:1787857029.449356:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857029.449369:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd2a280f/0xf326646fe3bbe59c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe595 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857029.449406:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd2a280f/0xf326646fe3bbe59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857029.449414:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd2a280f/0xf326646fe3bbe59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857029.449423:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd2a280f, rc 0) 00000100:00100000:3.0:1787857029.451055:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef00ae53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885013376:12345-0@lo:101: Request processed in 1705us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857029.451067:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787857029.452802:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053bdc4c5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013376:0@lo:101: 00010000:00010000:1.0:1787857029.452831:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe595 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857029.452843:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: 00000000516315de/0xf326646fe3bbe595 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857029.452911:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001382679d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013504:0@lo:501: 00000100:00100000:1.0:1787857029.452966:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857029.453013:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0900969 going to sleep for 11 seconds 00000100:00100000:0.0:1787857029.453117:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013504 00000100:00100000:0.0:1787857029.453123:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013504 00000100:00100000:0.0:1787857029.453207:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787857029.453215:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a3693c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885013504:12345-0@lo:501: 00000100:00100000:0.0:1787857029.453465:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a3693c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885013504:12345-0@lo:501: Request processed in 250us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857029.453472:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787857029.453543:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001382679d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013504:0@lo:501: 00000100:00100000:1.0:1787857029.453579:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001382679d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013632:0@lo:503: 00000100:00100000:1.0:1787857029.453616:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857029.455637:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0900969 going to sleep for 11 seconds 00000100:00100000:3.0:1787857029.455986:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013632 00000100:00100000:3.0:1787857029.455996:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013632 00000100:00100000:0.0:1787857029.456100:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857029.456112:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6dbe121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885013632:12345-0@lo:503: 00000100:00100000:0.0:1787857029.456352:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6dbe121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885013632:12345-0@lo:503: Request processed in 243us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857029.456420:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857029.459723:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001382679d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885013632:0@lo:503: 00000100:00100000:0.0:1787857029.460164:0:6639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc73ebe4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6639:1874703885013760:0@lo:502: 00000100:00100000:0.0:1787857029.460241:0:6639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857029.460285:0:6639:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f172085b going to sleep for 11 seconds 00000100:00100000:1.0:1787857029.460341:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013760 00000100:00100000:1.0:1787857029.460348:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013760 00000100:00100000:1.0:1787857029.460385:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787857029.460392:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000800135ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6639:x1874703885013760:12345-0@lo:502: 00000100:00100000:1.0:1787857029.460609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000800135ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6639:x1874703885013760:12345-0@lo:502: Request processed in 218us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857029.460616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787857029.462416:0:6639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc73ebe4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6639:1874703885013760:0@lo:502: 00000020:01000000:0.0:1787857029.462455:0:6639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857029.462465:0:6639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857029.462467:0:6639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787857029.462474:0:6639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96116a000 00000020:00000080:0.0:1787857029.462477:0:6639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787857029.462528:0:6639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6639:1874703885013888:0@lo:502: 00000100:00100000:0.0:1787857029.462595:0:6639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857029.462633:0:6639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857029.462711:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885013888 00000100:00100000:3.0:1787857029.462717:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885013888 00000100:00100000:3.0:1787857029.462806:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857029.462815:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6639:x1874703885013888:12345-0@lo:502: 00000100:00100000:3.0:1787857029.463004:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6639:x1874703885013888:12345-0@lo:502: Request processed in 190us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857029.463012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787857029.463112:0:6639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6639:1874703885013888:0@lo:502: 00000020:01000000:0.0:1787857029.463130:0:6639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857029.463135:0:6639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857029.463142:0:6639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787857029.463146:0:6639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787857029.463333:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787857029.463354:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857029.463364:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857029.463375:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857029.577872:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787857030.582914:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787857030.582918:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787857030.583054:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fd950737800 00000020:01000004:1.0:1787857030.583070:0:6674:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787857030.583080:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787857030.583093:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fd976998000) 00000020:00000080:1.0:1787857030.583108:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787857030.599417:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787857030.599656:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:1.0:1787857030.602321:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787857030.622161:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787857030.628135:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787857030.628174:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787857030.628252:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787857030.628299:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787857030.629419:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787857030.629432:0:6674:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787857030.629444:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf326646fe3bbe5aa 00000020:01000004:1.0:1787857030.629453:0:6674:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787857030.629476:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787857030.629480:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787857030.629486:0:6674:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787857030.629491:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787857030.629506:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fd97699cd70) 00000020:00000080:1.0:1787857030.629531:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787857030.631070:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857030.631244:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787857030.631250:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787857030.634308:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787857030.634321:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787857030.636333:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787857030.636342:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787857030.637918:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857030.638178:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787857030.638185:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787857030.650481:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787857030.650498:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787857030.692802:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857030.693534:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787857030.693540:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787857030.698274:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787857030.698293:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787857030.702365:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787857030.702384:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787857030.708193:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857030.708476:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787857030.708484:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787857030.709473:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787857030.709481:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787857030.789376:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857030.789781:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787857030.789788:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787857030.791603:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787857030.791617:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787857030.792418:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787857030.792442:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787857030.792449:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787857030.822794:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787857030.822962:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787857030.822967:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787857030.822969:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857030.822971:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857030.823044:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857030.823046:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857030.823048:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857030.823049:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857030.823051:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787857030.823053:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787857030.823054:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857030.823056:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787857030.823060:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787857030.823062:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787857030.823063:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857030.823064:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857030.823065:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857030.823066:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857030.823067:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857030.823068:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857030.823069:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787857030.823070:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787857030.823071:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857030.823072:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787857030.823103:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787857030.823123:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885014016:0@lo:253: 00000100:00100000:2.0:1787857030.823210:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.823330:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.823415:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014016 00000100:00100000:0.0:1787857030.823422:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014016 00000100:00100000:0.0:1787857030.823541:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787857030.823552:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885014016:12345-0@lo:253: 20000000:01000000:0.0:1787857030.823584:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787857030.823588:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787857030.823593:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787857030.823596:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787857030.824714:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857030.824921:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787857030.824935:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787857030.824978:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787857030.824986:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787857030.825016:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787857030.825061:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787857030.825418:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787857030.825437:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:0.0:1787857030.825439:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787857030.825473:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787857030.825481:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787857030.825565:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787857030.825574:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:0.0:1787857030.825609:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787857030.825618:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787857030.825650:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787857030.825726:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787857030.827337:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787857030.827377:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:0.0:1787857030.827380:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787857030.827419:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787857030.827428:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787857030.827461:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787857030.827469:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:0.0:1787857030.828462:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787857030.828481:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787857030.831493:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787857030.831642:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787857030.832065:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787857030.832070:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787857030.832076:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787857030.832078:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787857030.832080:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787857030.832094:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787857030.832096:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787857030.832147:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787857030.832150:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787857030.832791:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787857030.832864:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787857030.832926:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787857030.838396:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787857030.838460:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787857030.838499:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787857030.839776:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787857030.839784:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787857030.840585:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787857030.841149:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787857030.841205:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787857030.841286:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787857030.841307:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787857030.841309:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787857030.845812:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787857030.845917:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787857030.845980:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787857030.846491:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787857030.846550:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787857030.846614:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1787857030.846634:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787857030.846653:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846748:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846757:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846764:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846772:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846921:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.846950:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.846965:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a96940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014144:0@lo:104: 00000100:00100000:1.0:1787857030.847104:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857030.847172:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.847181:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 12 pid: 5829 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.847189:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014272:0@lo:104: 00000100:00100000:1.0:1787857030.847227:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857030.847308:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.847317:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 12 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.847325:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014400:0@lo:104: 00000100:00100000:1.0:1787857030.847348:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857030.850173:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014144 00000100:00100000:3.0:1787857030.850190:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014144 00000100:00100000:3.0:1787857030.850242:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014272 00000100:00100000:3.0:1787857030.850246:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014272 00000100:00100000:3.0:1787857030.850264:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857030.850272:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:5830:x1874703885014144:12345-0@lo:104: 00010000:00010000:3.0:1787857030.850290:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.850380:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787857030.850386:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:5830:x1874703885014144:12345-0@lo:104: Request processed in 115us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857030.850393:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857030.850410:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857030.850417:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5830:x1874703885014272:12345-0@lo:104: 00010000:00010000:3.0:1787857030.850425:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.850465:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787857030.850471:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5830:x1874703885014272:12345-0@lo:104: Request processed in 55us (3244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857030.850476:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787857030.850495:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857030.850503:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850521:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857030.850525:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850534:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857030.850560:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857030.850566:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857030.850615:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850637:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857030.850694:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850703:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe55d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850721:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857030.850725:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850730:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857030.850733:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850740:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857030.850746:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857030.850751:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857030.850773:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850779:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857030.850785:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850792:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940031400/0xf326646fe3bbe4e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4ed expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.850804:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857030.850806:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857030.850808:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857030.850840:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885014528:0@lo:103: 00000100:00100000:0.0:1787857030.850894:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.850938:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857030.850945:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885014656:0@lo:103: 00000100:00100000:0.0:1787857030.850967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.851016:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014528 00000100:00100000:0.0:1787857030.851021:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014528 00010000:00010000:0.0:1787857030.851043:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 13 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.851067:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014656 00000100:00100000:0.0:1787857030.851070:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014656 00010000:00010000:0.0:1787857030.851082:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 14 pid: 5829 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.851094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857030.851100:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3309:x1874703885014528:12345-0@lo:103: 00010000:00010000:0.0:1787857030.851122:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857030.851128:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 14 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.851140:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 14 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.851160:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857030.851191:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3309:x1874703885014528:12345-0@lo:103: Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.851198:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857030.851212:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857030.851218:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a6383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3309:x1874703885014656:12345-0@lo:103: 00010000:00010000:0.0:1787857030.851226:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857030.851230:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 13 pid: 5829 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.851239:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 13 pid: 5829 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.851248:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857030.851271:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a6383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3309:x1874703885014656:12345-0@lo:103: Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.851279:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857030.851320:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885014656:0@lo:103: 00000100:00100000:0.0:1787857030.851329:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885014528:0@lo:103: 00010000:00010000:0.0:1787857030.851365:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857030.855123:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e71d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787857030.855163:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031a00/0xf326646fe3bbe55d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe556 expref: 12 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.855182:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a96940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014144:0@lo:104: 00010000:00010000:1.0:1787857030.855196:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe4ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe4e6 expref: 11 pid: 5829 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.855232:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014272:0@lo:104: 00000100:00100000:2.0:1787857030.855297:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014400 00000100:00100000:2.0:1787857030.855305:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014400 00000100:00100000:0.0:1787857030.855380:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857030.855397:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5830:x1874703885014400:12345-0@lo:104: 00010000:00010000:0.0:1787857030.855413:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.855502:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857030.855519:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5830:x1874703885014400:12345-0@lo:104: Request processed in 125us (8170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.855527:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787857030.855595:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857030.855603:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.855610:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857030.855614:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.855634:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857030.855642:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857030.855648:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787857030.855712:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.855718:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857030.855738:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.855745:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940031000/0xf326646fe3bbe4ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe4d1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.855760:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857030.855762:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857030.855764:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857030.855777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885014784:0@lo:103: 00000100:00100000:3.0:1787857030.855815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.858108:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1874703885014400:0@lo:104: 00010000:00010000:1.0:1787857030.858147:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.858799:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014784 00000100:00100000:0.0:1787857030.858808:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014784 00010000:00010000:0.0:1787857030.858860:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 11 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.859087:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857030.859098:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3311:x1874703885014784:12345-0@lo:103: 00010000:00010000:0.0:1787857030.859116:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857030.859123:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 11 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859135:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 11 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859154:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953488800/0xf326646fe3bbe4d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe4ca expref: 11 pid: 5830 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859173:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859181:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859215:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859222:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859229:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859236:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859242:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857030.859246:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859254:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859279:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.859289:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857030.859367:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:3311:x1874703885014784:12345-0@lo:103: Request processed in 271us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.859374:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857030.859414:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885014784:0@lo:103: 00010000:00010000:0.0:1787857030.860489:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.860529:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.860536:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953488c00/0xf326646fe3bbe5b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787857030.860554:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787857030.931593:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:6674:x1874703885014016:12345-0@lo:253: Request processed in 108034us (108374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857030.931609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787857030.931785:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885014016:0@lo:253: 10000000:01000000:2.0:1787857030.931801:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787857030.931804:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787857030.931806:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857030.931807:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857030.931833:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787857030.931834:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857030.931835:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857030.931837:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857030.931839:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787857030.931840:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857030.931842:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787857030.931869:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd950737800 from lustre-OST0000 10000000:01000000:2.0:1787857030.931923:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787857030.931926:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787857030.931934:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fd942e119d0 local copy 10000000:01000000:2.0:1787857030.931939:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787857030.932063:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.932075:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.932086:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857030.932104:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885014912:0@lo:101: 00000100:00100000:2.0:1787857030.932151:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.932203:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.932413:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885014912 00000100:00100000:0.0:1787857030.932420:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885014912 00000100:00100000:0.0:1787857030.932475:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787857030.932485:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:6674:x1874703885014912:12345-0@lo:101: 00010000:00010000:0.0:1787857030.932500:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857030.932533:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe5bf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.932563:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe5bf expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.932574:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5bf expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.932582:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031400, rc 0) 00000100:00100000:0.0:1787857030.932624:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:6674:x1874703885014912:12345-0@lo:101: Request processed in 142us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.932630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787857030.932779:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885014912:0@lo:101: 00010000:00010000:2.0:1787857030.932793:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.932802:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857030.932900:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015040:0@lo:501: 00000100:00100000:2.0:1787857030.932941:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.933045:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.933220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015040 00000100:00100000:0.0:1787857030.933224:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015040 00000100:00100000:0.0:1787857030.933253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857030.933260:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:6674:x1874703885015040:12345-0@lo:501: 00000100:00100000:0.0:1787857030.933468:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:6674:x1874703885015040:12345-0@lo:501: Request processed in 208us (526us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857030.933476:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857030.933529:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015040:0@lo:501: 10000000:01000000:0.0:1787857030.933545:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787857030.933571:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787857030.933577:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933585:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933592:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933609:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787857030.933628:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd950737800 00010000:00010000:0.0:1787857030.933637:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857030.933642:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933650:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857030.933653:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933687:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857030.933695:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857030.933708:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857030.933727:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933734:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857030.933751:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933758:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe5bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe5c6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933772:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857030.933774:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857030.933775:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857030.933785:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885015168:0@lo:103: 00000100:00100000:0.0:1787857030.933823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.933864:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015168 00000100:00100000:0.0:1787857030.933867:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015168 00000100:00100000:0.0:1787857030.933902:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857030.933909:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:3312:x1874703885015168:12345-0@lo:103: 00010000:00010000:0.0:1787857030.933918:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857030.933929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe5bf expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.933943:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857030.933966:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:3312:x1874703885015168:12345-0@lo:103: Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.934172:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857030.934207:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885015168:0@lo:103: 10000000:01000000:0.0:1787857030.934222:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787857030.934229:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fd942e119d0 10000000:01000000:0.0:1787857030.934231:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787857030.934235:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fd942e119d0 from 1 10000000:01000000:0.0:1787857030.934237:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787857030.934256:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934264:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934272:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.934284:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015296:0@lo:101: 00000100:00100000:0.0:1787857030.934309:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.934330:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015296 00000100:00100000:0.0:1787857030.934334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015296 00000100:00100000:0.0:1787857030.934352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787857030.934358:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+9:6674:x1874703885015296:12345-0@lo:101: 00010000:00010000:0.0:1787857030.934368:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857030.934378:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031000/0xf326646fe3bbe5d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe5cd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934394:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031000/0xf326646fe3bbe5d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe5cd expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934403:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031000/0xf326646fe3bbe5d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5cd expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934420:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031000, rc 0) 00000100:00100000:0.0:1787857030.934444:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:6674:x1874703885015296:12345-0@lo:101: Request processed in 86us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.934449:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787857030.934470:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.934480:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015296:0@lo:101: 00010000:00010000:0.0:1787857030.934491:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934499:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857030.934652:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787857030.934739:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934748:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857030.934755:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787857030.934772:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787857030.934776:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787857030.934778:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857030.934791:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934799:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934822:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.934833:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015424:0@lo:101: 00000100:00100000:0.0:1787857030.934858:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.934875:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015424 00000100:00100000:0.0:1787857030.934889:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015424 00000100:00100000:0.0:1787857030.934909:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787857030.934914:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+10:6674:x1874703885015424:12345-0@lo:101: 00010000:00010000:0.0:1787857030.934921:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857030.934929:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe5db expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934941:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934949:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.934955:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940030e00, rc 0) 00000100:00100000:0.0:1787857030.935044:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015424:12345-0@lo:101: Request processed in 128us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.935050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787857030.935079:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.935088:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015424:0@lo:101: 00010000:00010000:0.0:1787857030.935098:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.935114:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857030.935185:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015552:0@lo:501: 00000100:00100000:0.0:1787857030.935206:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.935223:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015552 00000100:00100000:0.0:1787857030.935226:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015552 00000100:00100000:0.0:1787857030.935242:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787857030.935247:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015552:12345-0@lo:501: 00000100:00100000:0.0:1787857030.935429:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015552:12345-0@lo:501: Request processed in 180us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.935435:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787857030.935459:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.935469:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015552:0@lo:501: 00000100:00100000:0.0:1787857030.935491:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015680:0@lo:503: 00000100:00100000:0.0:1787857030.935725:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.935743:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015680 00000100:00100000:0.0:1787857030.935746:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015680 00000100:00100000:0.0:1787857030.935764:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787857030.935768:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015680:12345-0@lo:503: 00000100:00100000:0.0:1787857030.936111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015680:12345-0@lo:503: Request processed in 340us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.936117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787857030.936152:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.936163:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015680:0@lo:503: 00000040:00080000:0.0:1787857030.936462:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787857030.936608:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015808:0@lo:502: 00000100:00100000:0.0:1787857030.936647:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857030.936743:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857030.937053:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015808 00000100:00100000:2.0:1787857030.937059:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015808 00000100:00100000:2.0:1787857030.937119:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787857030.937127:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015808:12345-0@lo:502: 00000100:00100000:2.0:1787857030.938217:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015808:12345-0@lo:502: Request processed in 1085us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857030.938226:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787857030.938361:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015808:0@lo:502: 00000040:00080000:1.0:1787857030.938716:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787857030.938767:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787857030.938793:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787857030.938845:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787857030.938875:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787857030.939195:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787857030.939228:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015936:0@lo:502: 00000100:00100000:1.0:1787857030.939278:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.939646:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e71000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.939747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885015936 00000100:00100000:0.0:1787857030.939753:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885015936 00000100:00100000:0.0:1787857030.939788:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787857030.939796:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015936:12345-0@lo:502: 00000100:00100000:0.0:1787857030.940171:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885015936:12345-0@lo:502: Request processed in 375us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.940179:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787857030.940274:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885015936:0@lo:502: 00000040:00080000:1.0:1787857030.940384:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787857030.940397:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787857030.941349:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787857030.941360:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787857030.941367:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857030.941370:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787857030.941376:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787857030.941397:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fd97699b3a0) 00000020:00000080:1.0:1787857030.941419:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787857030.941426:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787857030.941487:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd950737800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787857030.941494:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787857030.941587:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf326646fe3bbe5f0 00010000:00010000:0.0:1787857030.952108:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787857030.952441:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787857030.957717:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787857030.958049:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787857030.967166:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787857030.968786:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787857030.975602:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787857030.975616:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857030.975622:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857030.975625:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787857030.975629:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857030.975633:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857030.975635:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787857030.975638:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787857030.975640:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787857030.975732:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857030.975736:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857030.975738:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787857030.975741:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787857030.978328:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787857030.978364:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787857030.978383:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.978395:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857030.978403:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd950737800 from 1 10000000:01000000:2.0:1787857030.978406:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857030.978443:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.978451:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.978463:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857030.978485:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016064:0@lo:101: 00000100:00100000:2.0:1787857030.978586:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.978639:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.979631:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016064 00000100:00100000:0.0:1787857030.979649:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016064 00000100:00100000:0.0:1787857030.979990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787857030.980000:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:6674:x1874703885016064:12345-0@lo:101: 00010000:00010000:0.0:1787857030.980014:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857030.980030:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe5f7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.980057:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.980068:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857030.980077:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031400, rc 0) 00000100:00100000:0.0:1787857030.980149:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016064:12345-0@lo:101: Request processed in 151us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.980157:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787857030.980249:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016064:0@lo:101: 00010000:00010000:3.0:1787857030.980267:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857030.980278:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857030.980401:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016192:0@lo:501: 00000100:00100000:3.0:1787857030.980432:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.983020:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016192 00000100:00100000:2.0:1787857030.983033:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016192 00000100:00100000:2.0:1787857030.983074:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857030.983082:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016192:12345-0@lo:501: 00000100:00100000:3.0:1787857030.983711:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857030.984429:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016192:12345-0@lo:501: Request processed in 1343us (3992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857030.984440:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787857030.984547:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016192:0@lo:501: 00000100:00100000:2.0:1787857030.984719:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016320:0@lo:503: 00000100:00100000:2.0:1787857030.985462:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.985513:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.985578:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016320 00000100:00100000:0.0:1787857030.985585:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016320 00000100:00100000:0.0:1787857030.985727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857030.985737:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016320:12345-0@lo:503: 00000100:00100000:0.0:1787857030.986102:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016320:12345-0@lo:503: Request processed in 366us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.986109:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787857030.986204:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016320:0@lo:503: 00000040:00080000:2.0:1787857030.986528:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787857030.986616:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016448:0@lo:502: 00000100:00100000:2.0:1787857030.986694:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.986721:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.986890:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016448 00000100:00100000:0.0:1787857030.986896:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016448 00000100:00100000:0.0:1787857030.986922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787857030.986928:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016448:12345-0@lo:502: 00000100:00100000:0.0:1787857030.987115:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016448:12345-0@lo:502: Request processed in 185us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.987128:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787857030.987334:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016448:0@lo:502: 00000040:00080000:1.0:1787857030.988060:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787857030.988127:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787857030.988159:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016576:0@lo:502: 00000100:00100000:1.0:1787857030.988209:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.988251:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857030.988394:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016576 00000100:00100000:2.0:1787857030.988401:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016576 00000100:00100000:2.0:1787857030.988443:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787857030.988461:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016576:12345-0@lo:502: 00000100:00100000:2.0:1787857030.988631:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016576:12345-0@lo:502: Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857030.988638:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787857030.988801:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016576:0@lo:502: 00000040:00080000:1.0:1787857030.988891:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787857030.988901:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787857030.989617:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857030.989626:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857030.989628:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787857030.989641:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd950737800 00000020:00000080:2.0:1787857030.989644:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787857030.989816:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857030.989820:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857030.989822:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787857030.989825:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787857030.992143:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787857030.992186:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857030.992218:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.992233:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857030.992294:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787857030.992297:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd950737800 10000000:01000000:1.0:1787857030.992300:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd950737800 10000000:01000000:1.0:1787857030.992304:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787857030.992310:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd950737800 from 1 10000000:01000000:1.0:1787857030.992313:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857030.992354:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.992374:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.992461:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.992489:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016704:0@lo:101: 00000100:00100000:1.0:1787857030.992573:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857030.992685:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016704 00000100:00100000:2.0:1787857030.992692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016704 00000100:00100000:1.0:1787857030.992697:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857030.992733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857030.992742:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885016704:12345-0@lo:101: 00010000:00010000:2.0:1787857030.992755:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857030.992772:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe605 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.992797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.992807:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857030.992817:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b000, rc 0) 00000100:00100000:2.0:1787857030.992870:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885016704:12345-0@lo:101: Request processed in 128us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857030.992876:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787857030.993014:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016704:0@lo:101: 00010000:00010000:1.0:1787857030.993028:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857030.993037:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857030.993133:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016832:0@lo:501: 00000100:00100000:1.0:1787857030.993158:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.993234:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857030.993422:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016832 00000100:00100000:0.0:1787857030.993428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016832 00000100:00100000:0.0:1787857030.993492:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787857030.993502:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885016832:12345-0@lo:501: 00000100:00100000:0.0:1787857030.993807:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885016832:12345-0@lo:501: Request processed in 306us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857030.993815:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787857030.993887:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016832:0@lo:501: 00000100:00100000:1.0:1787857030.993917:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016960:0@lo:503: 00000100:00100000:1.0:1787857030.993955:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.994138:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857030.994182:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885016960 00000100:00100000:2.0:1787857030.994187:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885016960 00000100:00100000:2.0:1787857030.994212:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787857030.994296:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885016960:12345-0@lo:503: 00000100:00100000:2.0:1787857030.994495:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885016960:12345-0@lo:503: Request processed in 276us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857030.994523:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787857030.994809:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885016960:0@lo:503: 00000040:00080000:1.0:1787857030.995091:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787857030.995170:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017088:0@lo:502: 00000100:00100000:1.0:1787857030.995214:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857030.995319:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857030.995402:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017088 00000100:00100000:3.0:1787857030.995407:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017088 00000100:00100000:3.0:1787857030.995484:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787857030.995493:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885017088:12345-0@lo:502: 00000100:00100000:3.0:1787857030.995724:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885017088:12345-0@lo:502: Request processed in 231us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857030.995731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787857030.995810:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017088:0@lo:502: 00000040:00080000:1.0:1787857030.996078:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787857030.996131:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787857030.996169:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787857030.996217:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787857030.996269:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787857030.996310:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787857030.996342:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787857030.996372:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787857030.996430:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787857030.996469:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787857030.996518:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787857030.996566:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787857030.996602:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787857030.996636:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787857030.997106:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787857030.997147:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787857030.997191:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787857030.997245:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787857030.997276:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787857030.997303:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787857030.997340:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787857030.997370:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787857030.997399:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787857030.997445:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787857030.997483:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787857030.997529:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787857030.997592:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787857030.997637:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787857030.997709:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017216:0@lo:502: 00000100:00100000:1.0:1787857030.997784:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857031.001518:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e713c0 going to sleep for 10 seconds 00000100:00100000:2.0:1787857031.001875:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017216 00000100:00100000:2.0:1787857031.001886:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017216 00000100:00100000:2.0:1787857031.001944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787857031.001955:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885017216:12345-0@lo:502: 00000100:00100000:2.0:1787857031.002251:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885017216:12345-0@lo:502: Request processed in 297us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857031.002259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787857031.002429:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017216:0@lo:502: 00000040:00080000:1.0:1787857031.002560:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787857031.002578:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787857031.003400:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787857031.003429:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fd841234d70) 00000020:00000080:1.0:1787857031.003449:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787857031.003540:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd950737800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787857031.003544:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd950737800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787857031.003547:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd950737800 3 00010000:00080000:1.0:1787857031.003578:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd9774a9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1787857031.006578:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787857031.006913:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787857031.006949:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787857031.006961:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf326646fe3bbe61a 00000100:00080000:1.0:1787857031.006971:0:6697:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787857031.006977:0:6697:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fd9774a9000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1787857031.007011:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd952a952c0 x1874703885017344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787857031.007042:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787857031.007130:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885017344:0@lo:38: 00000100:00100000:3.0:1787857031.007201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857031.007363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017344 00000100:00100000:1.0:1787857031.007371:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017344 00000100:00100000:1.0:1787857031.007408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787857031.007415:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885017344:12345-0@lo:38: 00010000:00080000:1.0:1787857031.007438:0:5836:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1787857031.007489:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf326646fe3bbe621 00000004:00100000:1.0:1787857031.007514:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787857031.007547:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9fd97fc15800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857031.007605:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874703885017344:12345-0@lo:38: Request processed in 189us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857031.007612:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787857031.007651:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd952a952c0 x1874703885017344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857031.007694:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787857031.007702:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787857031.007709:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787857031.007713:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787857031.007715:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787857031.007721:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885017344:0@lo:38: 00000100:00100000:3.0:1787857031.007910:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857031.007920:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885017472:0@lo:400: 00000100:00100000:3.0:1787857031.007951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857031.008051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017472 00000100:00100000:0.0:1787857031.008057:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017472 00000100:00100000:0.0:1787857031.008096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857031.008103:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885017472:12345-0@lo:400: 00000100:00100000:0.0:1787857031.008150:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885017472:12345-0@lo:400: Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857031.008157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787857031.008230:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd94a639a40 x1874703885017472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857031.008242:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885017472:0@lo:400: 00000040:00080000:1.0:1787857031.012694:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787857031.014435:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787857031.014478:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857031.014518:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857031.014542:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787857031.014592:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787857031.014595:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787857031.014596:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857031.014597:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857031.014598:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857031.014600:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857031.014601:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857031.014603:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857031.014605:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857031.014607:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857031.014608:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787857031.014612:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787857031.014614:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787857031.014615:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787857031.014617:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857031.014618:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857031.014619:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857031.014619:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857031.014620:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857031.014621:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857031.014622:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857031.014623:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857031.014624:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787857031.014654:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787857031.014697:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017600:0@lo:253: 00000100:00100000:3.0:1787857031.014771:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857031.014813:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857031.015029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017600 00000100:00100000:2.0:1787857031.015037:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017600 00000100:00100000:2.0:1787857031.015081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787857031.015091:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6674:x1874703885017600:12345-0@lo:253: 20000000:01000000:2.0:1787857031.015120:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787857031.015136:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787857031.046729:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787857031.046751:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787857031.046820:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787857031.046825:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787857031.046849:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857031.046867:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857031.046876:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857031.046914:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857031.046928:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 13 pid: 5831 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857031.046957:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885017728:0@lo:104: 00000100:00100000:2.0:1787857031.047025:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857031.047088:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857031.047322:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017728 00000100:00100000:0.0:1787857031.047331:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017728 00000100:00100000:0.0:1787857031.047384:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787857031.047393:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885017728:12345-0@lo:104: 00010000:00010000:0.0:1787857031.047406:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047469:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857031.047475:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885017728:12345-0@lo:104: Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857031.047495:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787857031.047530:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857031.047537:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047545:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341b800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857031.047549:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047557:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857031.047564:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857031.047569:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857031.047597:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047604:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857031.047620:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047626:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341b800/0xf326646fe3bbe580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe587 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857031.047642:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857031.047643:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857031.047645:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857031.047695:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885017856:0@lo:103: 00000100:00100000:0.0:1787857031.047735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857031.047788:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885017728:0@lo:104: 00010000:00010000:0.0:1787857031.047823:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857031.048003:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017856 00000100:00100000:1.0:1787857031.048008:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017856 00010000:00010000:1.0:1787857031.048027:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 14 pid: 5831 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857031.048050:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857031.048057:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3310:x1874703885017856:12345-0@lo:103: 00010000:00010000:1.0:1787857031.048068:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857031.048073:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 14 pid: 5831 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048084:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 14 pid: 5831 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048104:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe580 expref: 14 pid: 5831 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048117:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048125:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787857031.048137:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002144948s 00010000:00010000:1.0:1787857031.048141:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048149:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048155:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048162:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048168:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857031.048172:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048179:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048191:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048212:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857031.048249:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3310:x1874703885017856:12345-0@lo:103: Request processed in 192us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857031.048256:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857031.048314:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885017856:0@lo:103: 00010000:00010000:1.0:1787857031.048332:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048339:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857031.048345:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe628 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857031.058144:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:6674:x1874703885017600:12345-0@lo:253: Request processed in 43045us (43363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857031.058158:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787857031.058244:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:6674:1874703885017600:0@lo:253: 10000000:01000000:3.0:1787857031.058259:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787857031.058263:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787857031.058264:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787857031.058279:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857031.058280:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857031.058281:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857031.058283:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857031.058284:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857031.058286:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857031.058287:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857031.058290:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857031.058291:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787857031.058306:0:6674:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787857031.062648:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857031.063231:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787857031.063467:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857031.064097:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787857031.064347:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857031.064597:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787857031.066005:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787857031.329796:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787857031.329813:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787857031.329858:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787857031.329916:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787857031.329928:0:6674:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787857031.329951:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787857031.623755:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857032.647788:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857033.674920:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787857034.697399:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787857034.697406:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96116a000 from 21 10000000:01000000:2.0:1787857034.697411:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857034.697466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.697469:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857034.697478:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857034.697489:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857034.697513:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885017984:0@lo:101: 00000100:00100000:2.0:1787857034.698363:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.698409:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945798480 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.698484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885017984 00000100:00100000:0.0:1787857034.698492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885017984 00000100:00100000:0.0:1787857034.698551:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787857034.698681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885017984:12345-0@lo:101: 00010000:00010000:0.0:1787857034.698697:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857034.698715:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe62f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.699290:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.699306:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.699316:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940030200, rc 0) 00000100:00100000:0.0:1787857034.699374:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885017984:12345-0@lo:101: Request processed in 815us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.699399:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787857034.699508:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885017984:0@lo:101: 00010000:00010000:2.0:1787857034.699525:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857034.699541:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857034.700338:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018112:0@lo:501: 00000100:00100000:2.0:1787857034.700377:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.700412:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945798480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857034.700541:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018112 00000100:00100000:1.0:1787857034.700547:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018112 00000100:00100000:1.0:1787857034.700599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787857034.700607:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885018112:12345-0@lo:501: 00000100:00100000:1.0:1787857034.701458:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885018112:12345-0@lo:501: Request processed in 848us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857034.701466:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787857034.702281:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018112:0@lo:501: 00000100:00100000:2.0:1787857034.702328:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018240:0@lo:503: 00000100:00100000:2.0:1787857034.702386:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.702429:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945798480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857034.702477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018240 00000100:00100000:1.0:1787857034.702488:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018240 00000100:00100000:1.0:1787857034.702539:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787857034.702547:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885018240:12345-0@lo:503: 00000100:00100000:1.0:1787857034.702888:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885018240:12345-0@lo:503: Request processed in 341us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857034.702896:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787857034.705842:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018240:0@lo:503: 00000100:00100000:0.0:1787857034.715698:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6867:1874703885018368:0@lo:502: 00000100:00100000:0.0:1787857034.715796:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.715840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018368 00000100:00100000:2.0:1787857034.715847:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018368 00000100:00100000:0.0:1787857034.715849:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857034.715898:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787857034.715908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6867:x1874703885018368:12345-0@lo:502: 00000100:00100000:2.0:1787857034.716875:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6867:x1874703885018368:12345-0@lo:502: Request processed in 966us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857034.716884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857034.718065:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6867:1874703885018368:0@lo:502: 00000100:00100000:0.0:1787857034.718141:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6867:1874703885018496:0@lo:502: 00000100:00100000:0.0:1787857034.718200:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.718250:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857034.718414:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018496 00000100:00100000:3.0:1787857034.718422:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018496 00000100:00100000:3.0:1787857034.718491:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787857034.718502:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6867:x1874703885018496:12345-0@lo:502: 00000100:00100000:3.0:1787857034.719176:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:6867:x1874703885018496:12345-0@lo:502: Request processed in 673us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.719185:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787857034.719358:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6867:1874703885018496:0@lo:502: 00000040:00080000:0.0:1787857034.719386:0:6867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787857034.719534:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787857034.719553:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857034.719619:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.719630:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857034.719640:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787857034.719642:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96116a000 from 4 10000000:01000000:3.0:1787857034.719645:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787857034.720018:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.720470:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.720492:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857034.720509:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018624:0@lo:101: 00000100:00100000:3.0:1787857034.720626:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.720876:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.723220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018624 00000100:00100000:0.0:1787857034.723246:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018624 00000100:00100000:0.0:1787857034.723304:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787857034.723315:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885018624:12345-0@lo:101: 00010000:00010000:0.0:1787857034.723331:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857034.723350:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe63d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.723376:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.723387:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.723397:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031e00, rc 0) 00000100:00100000:0.0:1787857034.723480:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885018624:12345-0@lo:101: Request processed in 167us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.723494:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787857034.725127:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018624:0@lo:101: 00010000:00010000:3.0:1787857034.725155:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.725166:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857034.725233:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018752:0@lo:256: 00000100:00100000:3.0:1787857034.725289:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.725331:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.725372:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018752 00000100:00100000:0.0:1787857034.725378:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018752 00000100:00100000:0.0:1787857034.725416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787857034.725424:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885018752:12345-0@lo:256: 20000000:01000000:0.0:1787857034.725453:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787857034.725467:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787857034.725470:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787857034.725549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885018752:12345-0@lo:256: Request processed in 125us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.725567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787857034.726973:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018752:0@lo:256: 10000000:01000000:3.0:1787857034.727034:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787857034.727045:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.727056:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857034.727066:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787857034.727068:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787857034.727077:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787857034.727107:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.727114:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.727122:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857034.727139:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018880:0@lo:101: 00000100:00100000:3.0:1787857034.727186:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.727224:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.727275:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885018880 00000100:00100000:0.0:1787857034.727283:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885018880 00000100:00100000:0.0:1787857034.727322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787857034.727329:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885018880:12345-0@lo:101: 00010000:00010000:0.0:1787857034.727341:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857034.727353:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe64b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.727373:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.727384:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.727391:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031600, rc 0) 00000100:00100000:0.0:1787857034.727449:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885018880:12345-0@lo:101: Request processed in 120us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.727465:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857034.727467:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885018880:0@lo:101: 00010000:00010000:3.0:1787857034.727478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857034.727486:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857034.727536:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019008:0@lo:501: 00000100:00100000:3.0:1787857034.727561:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.727590:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857034.727683:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019008 00000100:00100000:1.0:1787857034.727688:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019008 00000100:00100000:1.0:1787857034.727715:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787857034.727722:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885019008:12345-0@lo:501: 00000100:00100000:1.0:1787857034.727975:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885019008:12345-0@lo:501: Request processed in 253us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857034.727982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857034.727991:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019008:0@lo:501: 00000100:00100000:3.0:1787857034.728019:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019136:0@lo:503: 00000100:00100000:3.0:1787857034.728058:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.728082:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.728148:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019136 00000100:00100000:0.0:1787857034.728153:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019136 00000100:00100000:0.0:1787857034.728178:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787857034.728185:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885019136:12345-0@lo:503: 00000100:00100000:0.0:1787857034.728539:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885019136:12345-0@lo:503: Request processed in 353us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.733704:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019136:0@lo:503: 00000100:00100000:3.0:1787857034.734184:0:6869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6869:1874703885019264:0@lo:502: 00000100:00100000:3.0:1787857034.734270:0:6869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.734358:0:6869:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942d900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857034.735084:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019264 00000100:00100000:3.0:1787857034.735092:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019264 00000100:00100000:0.0:1787857034.736469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857034.738377:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787857034.738393:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:6869:x1874703885019264:12345-0@lo:502: 00000100:00100000:3.0:1787857034.738760:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:6869:x1874703885019264:12345-0@lo:502: Request processed in 372us (4489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.738768:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787857034.738798:0:6869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6869:1874703885019264:0@lo:502: 00000020:01000000:2.0:1787857034.738834:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787857034.738841:0:6869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787857034.738848:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857034.738851:0:6869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787857034.738856:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787857034.738860:0:6869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:2.0:1787857034.738887:0:6869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787857034.738890:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787857034.738903:0:6869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fd942e14d70) 00000020:00000080:2.0:1787857034.738923:0:6869:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787857034.738928:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787857034.739005:0:6869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787857034.739010:0:6869:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787857034.739016:0:6869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe660 00010000:00080000:2.0:1787857034.739184:0:6869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd841207000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1787857034.739451:0:6869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787857034.842292:0:6869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787857034.842319:0:6869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787857034.843332:0:6869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857034.843791:0:6869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857034.844090:0:6869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787857034.844146:0:6869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787857034.845126:0:6873:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857034.845132:0:6873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787857034.847092:0:6869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857034.847107:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787857034.847143:0:6869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787857034.847163:0:6869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbe667 00000100:00080000:0.0:1787857034.847173:0:6869:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787857034.847179:0:6869:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fd841207000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857034.847214:0:6869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd94a63bc00 x1874703885019392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787857034.847315:0:6869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787857034.847382:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885019392:0@lo:8: 00000100:00100000:1.0:1787857034.847479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.847646:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019392 00000100:00100000:3.0:1787857034.847654:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019392 00000100:00100000:3.0:1787857034.847718:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857034.847725:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874703885019392:12345-0@lo:8: 00010000:00080000:3.0:1787857034.847761:0:6676:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1787857034.847785:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbe66e 00002000:00100000:3.0:1787857034.847828:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fd97fb9e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787857034.847833:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787857034.847837:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787857034.847958:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787857034.848159:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787857034.848183:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9fd97fb98000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857034.848241:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874703885019392:12345-0@lo:8: Request processed in 514us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.848249:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787857034.849047:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a63bc00 x1874703885019392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857034.849060:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787857034.849068:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787857034.849077:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787857034.849082:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787857034.849084:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd841207000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787857034.849103:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787857034.849109:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885019392:0@lo:8: 00000004:00080000:1.0:1787857034.849138:0:6873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787857034.849254:0:6873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 189177593014ns, next at 0ns, rc = 0 00000020:01000000:0.0:1787857034.855462:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857034.855472:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857034.855474:0:6869:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787857034.855478:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857034.855482:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857034.855483:0:6869:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787857034.855486:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787857034.855488:0:6869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787857034.855532:0:6869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6869:1874703885019520:0@lo:502: 00000100:00100000:0.0:1787857034.855627:0:6869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.855713:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019520 00000100:00100000:0.0:1787857034.855727:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019520 00000100:00100000:0.0:1787857034.855792:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787857034.855810:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:6869:x1874703885019520:12345-0@lo:502: 00000100:00100000:0.0:1787857034.856019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:6869:x1874703885019520:12345-0@lo:502: Request processed in 219us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.856026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787857034.856077:0:6869:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e84180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.856097:0:6869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:6869:1874703885019520:0@lo:502: 00000020:01000000:0.0:1787857034.856123:0:6869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857034.856128:0:6869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857034.856130:0:6869:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787857034.856133:0:6869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787857034.856185:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787857034.856201:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787857034.856211:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856221:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857034.856230:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787857034.856233:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fd942e119d0 from 1 10000000:01000000:0.0:1787857034.856236:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787857034.856259:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856266:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856275:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857034.856295:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019648:0@lo:101: 00000100:00100000:0.0:1787857034.856321:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.856338:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e84180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.856352:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019648 00000100:00100000:0.0:1787857034.856356:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019648 00000100:00100000:0.0:1787857034.856375:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787857034.856381:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885019648:12345-0@lo:101: 00010000:00010000:0.0:1787857034.856391:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857034.856404:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe675 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856425:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856445:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856454:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:0.0:1787857034.856482:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885019648:12345-0@lo:101: Request processed in 101us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857034.856487:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787857034.856516:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019648:0@lo:101: 00010000:00010000:0.0:1787857034.856528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856535:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857034.856584:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019776:0@lo:501: 00000100:00100000:0.0:1787857034.856608:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.856619:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e84180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857034.856631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019776 00000100:00100000:0.0:1787857034.856634:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019776 00000100:00100000:0.0:1787857034.856652:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787857034.856681:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885019776:12345-0@lo:501: 00000100:00100000:0.0:1787857034.856878:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885019776:12345-0@lo:501: Request processed in 219us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857034.856886:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787857034.856919:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885019776:0@lo:501: 10000000:01000000:0.0:1787857034.856938:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787857034.856943:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857034.856951:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857034.858231:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885019904:0@lo:400: 00000100:00100000:0.0:1787857034.858282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.858457:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857034.858464:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885020032:0@lo:400: 00000100:00100000:0.0:1787857034.858495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857034.865226:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885019904 00000100:00100000:3.0:1787857034.865253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885019904 00000100:00100000:3.0:1787857034.865306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020032 00000100:00100000:3.0:1787857034.865309:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020032 00000100:00100000:3.0:1787857034.865341:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857034.865350:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885019904:12345-0@lo:400: 00000100:00100000:3.0:1787857034.865446:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885019904:12345-0@lo:400: Request processed in 97us (7162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.865454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857034.865470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787857034.865477:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885020032:12345-0@lo:400: 00000100:00100000:3.0:1787857034.865505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885020032:12345-0@lo:400: Request processed in 30us (7010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857034.865511:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787857034.865539:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787857034.865966:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4bd680 x1874703885020032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857034.865980:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885020032:0@lo:400: 00010000:00080000:3.0:1787857034.865993:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4bc3c0 x1874703885019904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857034.866002:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885019904:0@lo:400: 00000004:00080000:2.0:1787857034.902979:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787857034.963090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885020160:0@lo:13: 00000100:00100000:1.0:1787857034.963173:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.963287:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020160 00000100:00100000:2.0:1787857034.963295:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020160 00000100:00080000:3.0:1787857034.963334:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857034.963353:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857034.963362:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787857034.963362:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885020160:12345-0@lo:13: 00000100:00100000:3.0:1787857034.963368:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787857034.963442:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:0.0:1787857034.963505:0:6874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787857034.963525:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020288:0@lo:7: 00000100:00100000:0.0:1787857034.963572:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.963591:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9495ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857034.964042:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885020160:12345-0@lo:13: Request processed in 680us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857034.964050:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787857034.964157:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a638b40 x1874703885020160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857034.964174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885020160:0@lo:13: 00000100:00100000:1.0:1787857034.964207:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020288 00000100:00100000:1.0:1787857034.964211:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020288 00000100:00100000:1.0:1787857034.964279:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787857034.964288:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1874703885020288:12345-0@lo:7: 00002000:00080000:1.0:1787857034.972341:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787857034.972350:0:6679:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787857034.972460:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1874703885020288:12345-0@lo:7: Request processed in 8169us (8882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857034.972470:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787857034.972742:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a6383c0 x1874703885020288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787857050 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857034.972769:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020288:0@lo:7: 00000004:00080000:0.0:1787857034.972784:0:6874:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787857034.972895:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020416:0@lo:5: 00000100:00100000:0.0:1787857034.972933:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.972973:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e84900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857034.973205:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020416 00000100:00100000:1.0:1787857034.973211:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020416 00000100:00100000:1.0:1787857034.973262:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787857034.973271:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6874:x1874703885020416:12345-0@lo:5: 00002000:00080000:1.0:1787857034.973292:0:6678:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787857034.973295:0:6678:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787857034.973547:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6874:x1874703885020416:12345-0@lo:5: Request processed in 276us (613us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1787857034.973709:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a6383c0 x1874703885020416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857050 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857034.973723:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020416:0@lo:5: 00000004:00080000:0.0:1787857034.973743:0:6874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787857034.973976:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020544:0@lo:700: 00000100:00100000:0.0:1787857034.974006:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857034.974035:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e84900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857034.974125:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020544 00000100:00100000:2.0:1787857034.974131:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020544 00000100:00100000:2.0:1787857034.974200:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857034.974216:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:6874:x1874703885020544:12345-0@lo:700: 00000100:00100000:2.0:1787857034.974246:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874703885020672:0@lo:700: 00000100:00100000:2.0:1787857034.974277:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857034.974308:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857034.974310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020672 00000100:00100000:3.0:1787857034.974314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020672 00000100:00100000:3.0:1787857034.974355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787857034.974361:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857034.974362:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874703885020672:12345-0@lo:700: 40000000:02000000:3.0:1787857035.023585:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787857035.035526:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874703885020672:12345-0@lo:700: Request processed in 61154us (61238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857035.035547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787857035.036238:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a404b40 x1874703885020672/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787857050 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857035.036254:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874703885020672:0@lo:700: 40000000:02000000:0.0:1787857035.036267:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1787857035.173262:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6874:x1874703885020544:12345-0@lo:700: Request processed in 199039us (199246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857035.173274:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787857035.173371:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a639680 x1874703885020544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787857050 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857035.173388:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020544:0@lo:700: 00000001:00080000:1.0:1787857035.176720:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787857035.178442:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1787857035.246230:0:6874:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787857035.257035:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020800:0@lo:5: 00000100:00100000:1.0:1787857035.257106:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857035.257162:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d4f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857035.261063:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020800 00000100:00100000:0.0:1787857035.261076:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020800 00000100:00100000:0.0:1787857035.261136:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857035.261145:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6874:x1874703885020800:12345-0@lo:5: 00002000:00080000:1.0:1787857035.283117:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787857035.283140:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787857035.290690:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1874703885020800:12345-0@lo:5: Request processed in 29511us (33549us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787857035.290703:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787857035.291048:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd952a952c0 x1874703885020800/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857051 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857035.291064:0:6874:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787857035.291078:0:6874:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fd952a952c0 x1874703885020800/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857051 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857035.291089:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a952c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1874703885020800:0@lo:5: 00000004:00080000:2.0:1787857035.291103:0:6874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787857035.720040:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857036.744815:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857037.769902:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857038.030536:0:7046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787857038.792928:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857039.815866:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857040.205040:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021312:0@lo:400: 00000100:00100000:3.0:1787857040.205137:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857040.205196:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857040.205203:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885020928:0@lo:400: 00000100:00100000:3.0:1787857040.205234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857040.205261:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885021056:0@lo:400: 00000100:00100000:3.0:1787857040.205289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857040.205313:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857040.205318:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885021184:0@lo:400: 00000100:00100000:3.0:1787857040.205351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857040.205383:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021312 00000100:00100000:3.0:1787857040.205393:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021312 00000100:00100000:3.0:1787857040.206951:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857040.206962:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885021312:12345-0@lo:400: 00000100:00100000:3.0:1787857040.207034:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885021312:12345-0@lo:400: Request processed in 74us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857040.207041:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857040.207068:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021056 00000100:00100000:3.0:1787857040.207074:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021056 00000100:00100000:3.0:1787857040.208516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021184 00000100:00100000:3.0:1787857040.208527:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021184 00000100:00100000:3.0:1787857040.208562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857040.208570:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885021056:12345-0@lo:400: 00000100:00100000:3.0:1787857040.208654:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885021056:12345-0@lo:400: Request processed in 84us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857040.208693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857040.208708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787857040.208715:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885021184:12345-0@lo:400: 00000100:00100000:3.0:1787857040.208744:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885021184:12345-0@lo:400: Request processed in 30us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857040.208750:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787857040.208772:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857040.208777:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787857040.208824:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4be940 x1874703885021184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857040.208838:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885021184:0@lo:400: 00010000:00080000:3.0:1787857040.208849:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4bc3c0 x1874703885021056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857040.208856:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885021056:0@lo:400: 00010000:00080000:3.0:1787857040.208890:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4bcf00 x1874703885021312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857040.208899:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021312:0@lo:400: 00000100:00100000:3.0:1787857040.208908:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857040.208919:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021440:0@lo:13: 00000100:00100000:3.0:1787857040.208951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857040.208985:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021440 00000100:00100000:3.0:1787857040.208989:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021440 00000100:00100000:3.0:1787857040.209018:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857040.209024:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885021440:12345-0@lo:13: 00002000:00000024:3.0:1787857040.209052:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857040.209097:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885021440:12345-0@lo:13: Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857040.209103:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787857040.209128:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd952a96d00 x1874703885021440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857040.209144:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021440:0@lo:13: 00000100:00100000:1.0:1787857040.218200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885020928 00000100:00100000:1.0:1787857040.218215:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885020928 00000100:00100000:1.0:1787857040.218278:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787857040.218287:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3309:x1874703885020928:12345-0@lo:400: 00000100:00100000:1.0:1787857040.218390:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3309:x1874703885020928:12345-0@lo:400: Request processed in 103us (13153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857040.218397:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787857040.228477:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885020928:0@lo:400: 00000001:00080000:1.0:1787857040.327638:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787857040.839982:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857041.865800:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857042.887780:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857043.917221:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857044.936859:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857045.320010:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885021568:0@lo:400: 00000100:00100000:3.0:1787857045.320082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857045.320140:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857045.320146:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885021696:0@lo:400: 00000100:00100000:3.0:1787857045.320172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857045.320196:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885021824:0@lo:400: 00000100:00100000:3.0:1787857045.320215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857045.320314:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021568 00000100:00100000:2.0:1787857045.320322:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021568 00000100:00100000:2.0:1787857045.320361:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857045.320369:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3311:x1874703885021568:12345-0@lo:400: 00000100:00100000:2.0:1787857045.320420:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3311:x1874703885021568:12345-0@lo:400: Request processed in 52us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857045.320451:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857045.320500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021696 00000100:00100000:2.0:1787857045.320504:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021696 00000100:00100000:2.0:1787857045.320528:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021824 00000100:00100000:2.0:1787857045.320531:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021824 00000100:00100000:2.0:1787857045.320556:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857045.320561:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885021696:12345-0@lo:400: 00000100:00100000:2.0:1787857045.320591:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885021696:12345-0@lo:400: Request processed in 30us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857045.320609:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857045.320620:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787857045.320626:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885021824:12345-0@lo:400: 00000100:00100000:2.0:1787857045.320651:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885021824:12345-0@lo:400: Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857045.320656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787857045.320796:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a404000 x1874703885021696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857045.320809:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885021696:0@lo:400: 00000100:00100000:2.0:1787857045.320816:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885021568:0@lo:400: 00000100:00080000:2.0:1787857045.320840:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787857045.320961:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a405e00 x1874703885021824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857045.320970:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885021824:0@lo:400: 00000100:00100000:3.0:1787857045.320984:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857045.320991:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021952:0@lo:400: 00000100:00100000:3.0:1787857045.321019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857045.321159:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885021952 00000100:00100000:2.0:1787857045.321164:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885021952 00000100:00100000:2.0:1787857045.321206:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857045.321213:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885021952:12345-0@lo:400: 00000100:00100000:2.0:1787857045.321327:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885021952:12345-0@lo:400: Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857045.321341:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787857045.321398:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787857045.321416:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a406940 x1874703885021952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857045.321487:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787857045.321502:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885021952:0@lo:400: 00000100:00100000:1.0:1787857045.321572:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857045.321582:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885022080:0@lo:13: 00000100:00100000:1.0:1787857045.321619:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857045.321957:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022080 00000100:00100000:3.0:1787857045.321963:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022080 00000100:00100000:3.0:1787857045.322001:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857045.322008:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885022080:12345-0@lo:13: 00002000:00000024:3.0:1787857045.322041:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857045.322083:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885022080:12345-0@lo:13: Request processed in 75us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857045.322089:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787857045.322184:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd952a96d00 x1874703885022080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857045.322198:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885022080:0@lo:13: 00010000:00010000:2.0:1787857045.959817:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857046.983814:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857048.008011:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857049.039549:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787857049.790575:0:7610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787857049.790579:0:7610:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787857049.790744:0:7610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fd975d01000 00000020:01000004:3.0:1787857049.790762:0:7610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787857049.790775:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787857049.790799:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fd96d9b33a0) 00000020:00000080:3.0:1787857049.790817:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787857049.856088:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787857049.857829:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787857049.889637:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787857049.897468:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787857049.897508:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787857049.897567:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787857049.897590:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787857049.897934:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787857049.897946:0:7610:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787857049.897955:0:7610:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf326646fe3bbe68a 00000020:01000004:2.0:1787857049.897962:0:7610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787857049.897982:0:7610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787857049.897985:0:7610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787857049.897990:0:7610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787857049.898008:0:7610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787857049.898012:0:7610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787857049.932105:0:7610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787857049.932155:0:7610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.129@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787857049.932160:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787857049.932161:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787857049.932163:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857049.932164:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857049.932165:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857049.932166:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857049.932168:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857049.932169:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857049.932170:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857049.932172:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857049.932173:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787857049.932176:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787857049.932179:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787857049.932180:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787857049.932181:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857049.932182:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857049.932183:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857049.932188:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857049.932189:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857049.932189:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787857049.932190:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787857049.932191:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857049.932192:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787857049.932217:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787857049.932236:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885022208:0@lo:253: 00000100:00100000:3.0:1787857049.932318:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857049.932364:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456baf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857049.932619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022208 00000100:00100000:1.0:1787857049.932626:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022208 00000100:00100000:1.0:1787857049.932718:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857049.932727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:7610:x1874703885022208:12345-0@lo:253: 20000000:01000000:1.0:1787857049.932758:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787857049.932762:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787857049.932767:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787857049.932770:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787857049.933777:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787857049.933987:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787857049.934002:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787857049.934044:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787857049.934052:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787857049.934082:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787857049.934126:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787857049.934521:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787857049.934553:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:1.0:1787857049.934555:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787857049.934590:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787857049.934600:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787857049.934646:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787857049.934653:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:1.0:1787857049.934721:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787857049.934731:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787857049.934762:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787857049.934813:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787857049.939640:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787857049.940819:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.129@tcp 20000000:01000000:1.0:1787857049.940824:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787857049.940913:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787857049.940924:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787857049.940961:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787857049.940968:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.129@tcp (null) (null) 00000040:00080000:1.0:1787857049.941019:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787857049.941029:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787857049.941134:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787857049.941192:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787857049.942195:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787857049.942200:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787857049.942205:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787857049.942354:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787857049.942358:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787857049.942420:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787857049.942423:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787857049.943431:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787857049.943539:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787857049.943858:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787857049.944370:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787857049.944419:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787857049.944457:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787857049.944470:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787857049.944472:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787857049.946129:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787857049.946254:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787857049.946301:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787857049.946830:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787857049.946882:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787857049.946948:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787857049.946967:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787857049.946970:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787857049.948532:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787857049.950013:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787857049.950060:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787857049.950132:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787857049.950160:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787857049.950162:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787857049.954488:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787857049.954626:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787857049.954729:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787857049.955130:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787857049.955190:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787857049.955272:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787857049.955291:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787857049.955294:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787857049.955303:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787857049.955326:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955348:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955357:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955364:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955372:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955379:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955398:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955446:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955466:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.955483:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022336:0@lo:104: 00000100:00100000:3.0:1787857049.955572:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857049.955638:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955647:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 16 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.955656:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022464:0@lo:104: 00010000:00010000:3.0:1787857049.955721:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955729:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 16 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.955738:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022592:0@lo:104: 00010000:00010000:3.0:1787857049.955761:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955769:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 16 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.955783:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022720:0@lo:104: 00010000:00010000:3.0:1787857049.955806:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.955814:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 16 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.955822:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022848:0@lo:104: 00000100:00100000:3.0:1787857049.955840:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba000 going to sleep for 11 seconds 00000100:00100000:1.0:1787857049.955919:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787857049.955939:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.955954:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.955963:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.955971:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.955981:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022336 00000100:00100000:1.0:1787857049.955988:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022336 00000100:00100000:1.0:1787857049.956022:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022464 00000100:00100000:1.0:1787857049.956025:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022464 00000100:00100000:1.0:1787857049.956035:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022592 00000100:00100000:1.0:1787857049.956043:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022592 00000100:00100000:1.0:1787857049.956055:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022720 00000100:00100000:1.0:1787857049.956057:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022720 00000100:00100000:1.0:1787857049.956065:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022848 00000100:00100000:1.0:1787857049.956067:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022848 00000100:00100000:1.0:1787857049.956079:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857049.956086:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+7:5831:x1874703885022336:12345-0@lo:104: 00010000:00010000:1.0:1787857049.956098:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956176:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857049.956182:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945b3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+7:5831:x1874703885022336:12345-0@lo:104: Request processed in 96us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.956189:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857049.956230:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857049.956236:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5831:x1874703885022464:12345-0@lo:104: 00010000:00010000:1.0:1787857049.956243:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956275:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787857049.956280:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+6:5831:x1874703885022464:12345-0@lo:104: Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.956286:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857049.956297:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787857049.956302:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:5831:x1874703885022592:12345-0@lo:104: 00010000:00010000:1.0:1787857049.956309:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956334:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787857049.956345:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:5831:x1874703885022592:12345-0@lo:104: Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.956350:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787857049.956364:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787857049.956369:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:5831:x1874703885022720:12345-0@lo:104: 00010000:00010000:1.0:1787857049.956377:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956403:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787857049.956408:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:5831:x1874703885022720:12345-0@lo:104: Request processed in 40us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.956413:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787857049.956424:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857049.956431:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5831:x1874703885022848:12345-0@lo:104: 00010000:00010000:1.0:1787857049.956438:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956463:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787857049.956467:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5831:x1874703885022848:12345-0@lo:104: Request processed in 38us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.956472:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787857049.956490:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787857049.956496:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956503:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030600 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857049.956507:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956527:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857049.956534:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857049.956540:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857049.956573:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956580:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857049.956600:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956607:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940030600/0xf326646fe3bbe675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe67c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956621:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787857049.956624:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956630:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857049.956633:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956639:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857049.956645:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857049.956656:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857049.956701:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956707:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857049.956722:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956729:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd98216dc00/0xf326646fe3bbe64b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe652 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956741:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787857049.956744:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956750:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a200 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857049.956752:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956759:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857049.956766:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857049.956771:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857049.956782:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956788:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857049.956802:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956809:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341a200/0xf326646fe3bbe62f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe636 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956818:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787857049.956821:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956827:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489e00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857049.956830:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956836:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857049.956842:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857049.956847:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857049.956860:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956865:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857049.956870:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956876:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe60c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956885:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857049.956894:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956900:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031a00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857049.956903:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956909:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857049.956915:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857049.956920:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857049.956944:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956949:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857049.956954:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956960:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940031a00/0xf326646fe3bbe5db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5e2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.956975:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857049.956977:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857049.956978:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857049.957007:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885022976:0@lo:103: 00000100:00100000:1.0:1787857049.957048:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.957070:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885023488:0@lo:103: 00000100:00100000:1.0:1787857049.957102:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.957123:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857049.957129:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885023360:0@lo:103: 00000100:00100000:1.0:1787857049.957161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.957184:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885023232:0@lo:103: 00000100:00100000:1.0:1787857049.957204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.957216:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857049.957221:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885023104:0@lo:103: 00000100:00100000:1.0:1787857049.957239:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857049.957263:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885022976 00000100:00100000:1.0:1787857049.957269:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885022976 00010000:00010000:1.0:1787857049.957288:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 17 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857049.957303:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023488 00000100:00100000:1.0:1787857049.957306:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023488 00010000:00010000:1.0:1787857049.957314:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 18 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857049.957323:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023360 00000100:00100000:1.0:1787857049.957324:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023360 00010000:00010000:1.0:1787857049.957332:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857049.957341:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023232 00000100:00100000:1.0:1787857049.957344:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023232 00010000:00010000:1.0:1787857049.957353:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 20 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857049.957362:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023104 00000100:00100000:1.0:1787857049.957370:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023104 00010000:00010000:1.0:1787857049.957383:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857049.957395:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857049.957401:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+21:3312:x1874703885022976:12345-0@lo:103: 00010000:00010000:1.0:1787857049.957412:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857049.957416:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957426:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 21 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957443:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857049.957472:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+21:3312:x1874703885022976:12345-0@lo:103: Request processed in 71us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.957479:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857049.957493:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857049.957499:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3312:x1874703885023488:12345-0@lo:103: 00010000:00010000:1.0:1787857049.957505:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857049.957510:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 20 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957517:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 20 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957527:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857049.957549:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3312:x1874703885023488:12345-0@lo:103: Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.957555:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857049.957578:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787857049.957583:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885023360:12345-0@lo:103: 00010000:00010000:1.0:1787857049.957591:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857049.957595:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957603:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 19 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957611:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857049.957633:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885023360:12345-0@lo:103: Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.957638:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787857049.957648:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787857049.957653:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3310:x1874703885023232:12345-0@lo:103: 00010000:00010000:1.0:1787857049.957684:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857049.957689:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 18 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957696:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 18 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957705:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857049.957731:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3310:x1874703885023232:12345-0@lo:103: Request processed in 78us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.957738:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787857049.957748:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857049.957754:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3310:x1874703885023104:12345-0@lo:103: 00010000:00010000:1.0:1787857049.957762:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857049.957772:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 17 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957781:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 17 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957793:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957801:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957817:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957825:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957832:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957839:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957844:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857049.957848:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957856:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957863:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857049.957883:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857049.957907:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3310:x1874703885023104:12345-0@lo:103: Request processed in 153us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857049.957912:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857049.957948:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885023104:0@lo:103: 00000100:00100000:1.0:1787857049.957957:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885023232:0@lo:103: 00000100:00100000:1.0:1787857049.957984:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885023360:0@lo:103: 00000100:00100000:1.0:1787857049.957991:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885022976:0@lo:103: 00000100:00100000:1.0:1787857049.957998:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885023488:0@lo:103: 00010000:00010000:2.0:1787857049.958086:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857049.958241:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982044600/0xf326646fe3bbe67c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe675 expref: 16 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.958254:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022336:0@lo:104: 00010000:00010000:3.0:1787857049.958263:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031600/0xf326646fe3bbe652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe64b expref: 15 pid: 5829 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.958270:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022464:0@lo:104: 00010000:00010000:3.0:1787857049.958278:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940030200/0xf326646fe3bbe636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe62f expref: 14 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.958286:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71f840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022592:0@lo:104: 00010000:00010000:3.0:1787857049.958293:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b000/0xf326646fe3bbe60c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe605 expref: 13 pid: 5831 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.958300:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71de00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022720:0@lo:104: 00010000:00010000:3.0:1787857049.958307:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbe5e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe5db expref: 12 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857049.958325:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5831:1874703885022848:0@lo:104: 00010000:00010000:3.0:1787857049.958342:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.958352:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.958358:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857049.958364:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe691 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787857049.958378:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787857050.006930:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:7610:x1874703885022208:12345-0@lo:253: Request processed in 74196us (74604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.006946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787857050.007028:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885022208:0@lo:253: 10000000:01000000:3.0:1787857050.007044:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787857050.007047:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787857050.007049:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787857050.007051:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857050.007052:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787857050.007053:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857050.007054:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857050.007055:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857050.007057:0:7610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787857050.007059:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857050.007060:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787857050.007082:0:7610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd975d01000 from lustre-OST0001 10000000:01000000:3.0:1787857050.007106:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787857050.007109:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787857050.007117:0:7610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fd942e119d0 local copy 10000000:01000000:3.0:1787857050.007122:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787857050.007182:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.007193:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.007204:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857050.007222:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023616:0@lo:101: 00000100:00100000:3.0:1787857050.007257:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.007298:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857050.007354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023616 00000100:00100000:1.0:1787857050.007360:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023616 00000100:00100000:1.0:1787857050.007399:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787857050.007407:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:7610:x1874703885023616:12345-0@lo:101: 00010000:00010000:1.0:1787857050.007419:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857050.007432:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe698 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.007608:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe698 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.007619:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe698 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.007628:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489e00, rc 0) 00000100:00100000:1.0:1787857050.007779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885023616:12345-0@lo:101: Request processed in 373us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857050.007794:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787857050.007855:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023616:0@lo:101: 00010000:00010000:3.0:1787857050.007868:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.007876:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857050.007978:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023744:0@lo:501: 00000100:00100000:3.0:1787857050.008005:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.008063:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.008099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023744 00000100:00100000:0.0:1787857050.008103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023744 00000100:00100000:0.0:1787857050.008170:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787857050.008178:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885023744:12345-0@lo:501: 00000100:00100000:0.0:1787857050.008375:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885023744:12345-0@lo:501: Request processed in 197us (368us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857050.008382:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787857050.008439:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023744:0@lo:501: 10000000:01000000:3.0:1787857050.008461:0:7610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787857050.008485:0:7610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787857050.008491:0:7610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.008499:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.008512:0:7610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.008532:0:7610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787857050.008549:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd975d01000 10000000:01000000:3.0:1787857050.008555:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787857050.008559:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787857050.008562:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787857050.008565:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787857050.008568:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787857050.008584:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.008591:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.008599:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857050.008610:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023872:0@lo:101: 00000100:00100000:3.0:1787857050.008634:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857050.008686:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857050.008693:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008701:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857050.008705:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008713:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857050.008719:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857050.008725:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857050.008744:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008751:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857050.008776:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008784:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd98216d800/0xf326646fe3bbe698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf326646fe3bbe69f expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008798:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857050.008800:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857050.008801:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857050.008812:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857050.008829:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885024000:0@lo:103: 00000100:00100000:1.0:1787857050.008859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857050.008896:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024000 00000100:00100000:1.0:1787857050.008900:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024000 00000100:00100000:1.0:1787857050.008928:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787857050.008934:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3310:x1874703885024000:12345-0@lo:103: 00010000:00010000:1.0:1787857050.008944:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857050.008956:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe698 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.008969:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857050.009009:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:3310:x1874703885024000:12345-0@lo:103: Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857050.009015:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787857050.009041:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885024000:0@lo:103: 00000100:00100000:3.0:1787857050.009651:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.009867:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885023872 00000100:00100000:2.0:1787857050.009873:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885023872 00000100:00100000:2.0:1787857050.009903:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787857050.009910:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+11:7610:x1874703885023872:12345-0@lo:101: 00010000:00010000:2.0:1787857050.009934:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857050.009949:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe6a6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.009971:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.009983:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.009991:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341bc00, rc 0) 00000100:00100000:2.0:1787857050.010044:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885023872:12345-0@lo:101: Request processed in 134us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.010051:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787857050.010146:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885023872:0@lo:101: 00010000:00010000:3.0:1787857050.010162:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857050.010170:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857050.010267:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024128:0@lo:501: 00000100:00100000:3.0:1787857050.010312:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.010342:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.010395:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024128 00000100:00100000:2.0:1787857050.010399:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024128 00000100:00100000:2.0:1787857050.010416:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787857050.010422:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024128:12345-0@lo:501: 00000100:00100000:2.0:1787857050.010693:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024128:12345-0@lo:501: Request processed in 269us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.010700:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787857050.010780:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024128:0@lo:501: 00000100:00100000:3.0:1787857050.010807:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024256:0@lo:503: 00000100:00100000:3.0:1787857050.010847:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.010874:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.011047:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024256 00000100:00100000:2.0:1787857050.011051:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024256 00000100:00100000:2.0:1787857050.011068:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857050.011072:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024256:12345-0@lo:503: 00000100:00100000:2.0:1787857050.011235:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024256:12345-0@lo:503: Request processed in 160us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.011242:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787857050.011380:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024256:0@lo:503: 00000040:00080000:3.0:1787857050.011655:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787857050.011759:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024384:0@lo:502: 00000100:00100000:3.0:1787857050.011800:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.011813:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.011878:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024384 00000100:00100000:2.0:1787857050.011883:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024384 00000100:00100000:2.0:1787857050.011904:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787857050.011910:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024384:12345-0@lo:502: 00000100:00100000:2.0:1787857050.012053:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024384:12345-0@lo:502: Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.012060:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787857050.012211:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024384:0@lo:502: 00000040:00080000:3.0:1787857050.012485:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787857050.012532:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787857050.012564:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787857050.012621:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787857050.012692:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787857050.012729:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787857050.012753:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024512:0@lo:502: 00000100:00100000:3.0:1787857050.012793:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857050.012816:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456ba480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.012980:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024512 00000100:00100000:2.0:1787857050.012985:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024512 00000100:00100000:2.0:1787857050.013008:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787857050.013015:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024512:12345-0@lo:502: 00000100:00100000:2.0:1787857050.013173:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024512:12345-0@lo:502: Request processed in 157us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.013180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787857050.013262:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024512:0@lo:502: 00000040:00080000:3.0:1787857050.013414:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787857050.013432:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787857050.014019:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787857050.014028:0:7617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787857050.014035:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857050.014038:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787857050.014044:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787857050.014066:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fd96db8cd70) 00000020:00000080:2.0:1787857050.014088:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787857050.014095:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787857050.014176:0:7617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd975d01000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787857050.014183:0:7617:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787857050.014192:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf326646fe3bbe6bb 00010000:00010000:2.0:1787857050.017747:0:7617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787857050.018038:0:7617:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787857050.021595:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787857050.022010:0:7617:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787857050.026256:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787857050.027155:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787857050.028572:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787857050.028586:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857050.028594:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857050.028596:0:7617:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787857050.028600:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857050.028605:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857050.028607:0:7617:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787857050.028610:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787857050.028612:0:7617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787857050.028696:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857050.028700:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857050.028702:0:7617:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787857050.028705:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787857050.030912:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787857050.030951:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787857050.031018:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.031039:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857050.031048:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd975d01000 from 1 10000000:01000000:0.0:1787857050.031050:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787857050.031089:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.031097:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.031109:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857050.032805:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024640:0@lo:101: 00000100:00100000:0.0:1787857050.032885:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.032934:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.033028:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024640 00000100:00100000:2.0:1787857050.033035:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024640 00000100:00100000:2.0:1787857050.033091:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787857050.033110:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:7610:x1874703885024640:12345-0@lo:101: 00010000:00010000:2.0:1787857050.033125:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857050.033153:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe6c2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.033179:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.033190:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.033199:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a400, rc 0) 00000100:00100000:2.0:1787857050.033240:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885024640:12345-0@lo:101: Request processed in 132us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.033246:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787857050.033407:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024640:0@lo:101: 00010000:00010000:0.0:1787857050.033422:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.033431:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857050.033551:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024768:0@lo:501: 00000100:00100000:0.0:1787857050.033580:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.033611:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.033631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024768 00000100:00100000:0.0:1787857050.033636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024768 00000100:00100000:0.0:1787857050.033689:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787857050.033696:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885024768:12345-0@lo:501: 00000100:00100000:0.0:1787857050.033925:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885024768:12345-0@lo:501: Request processed in 229us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.033933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787857050.033965:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024768:0@lo:501: 00000100:00100000:0.0:1787857050.033993:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024896:0@lo:503: 00000100:00100000:0.0:1787857050.034032:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.034046:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.034059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885024896 00000100:00100000:0.0:1787857050.034063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885024896 00000100:00100000:0.0:1787857050.034080:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787857050.034086:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885024896:12345-0@lo:503: 00000100:00100000:0.0:1787857050.034700:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885024896:12345-0@lo:503: Request processed in 612us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.034708:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787857050.035028:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885024896:0@lo:503: 00000040:00080000:2.0:1787857050.035323:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787857050.035401:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025024:0@lo:502: 00000100:00100000:2.0:1787857050.035576:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.035621:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.036752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025024 00000100:00100000:0.0:1787857050.036765:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025024 00000100:00100000:0.0:1787857050.036827:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787857050.036837:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885025024:12345-0@lo:502: 00000100:00100000:0.0:1787857050.037094:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885025024:12345-0@lo:502: Request processed in 258us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.037103:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787857050.037272:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025024:0@lo:502: 00000040:00080000:2.0:1787857050.037868:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787857050.037930:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787857050.037965:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025152:0@lo:502: 00000100:00100000:2.0:1787857050.038016:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.038450:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.038654:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025152 00000100:00100000:0.0:1787857050.038878:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025152 00000100:00100000:0.0:1787857050.038969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787857050.038978:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885025152:12345-0@lo:502: 00000100:00100000:0.0:1787857050.039189:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885025152:12345-0@lo:502: Request processed in 212us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.039197:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787857050.039247:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025152:0@lo:502: 00000040:00080000:0.0:1787857050.039363:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787857050.039376:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787857050.040197:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857050.040209:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857050.040211:0:7621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787857050.040218:0:7621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd975d01000 00000020:00000080:0.0:1787857050.040221:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787857050.040239:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857050.040242:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857050.040243:0:7621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787857050.040246:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787857050.040523:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787857050.040554:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857050.040624:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.040636:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857050.040717:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787857050.040721:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd975d01000 10000000:01000000:2.0:1787857050.040724:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd975d01000 10000000:01000000:2.0:1787857050.040728:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787857050.040734:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd975d01000 from 1 10000000:01000000:2.0:1787857050.040737:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857050.040770:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.040778:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.040788:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857050.040813:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025280:0@lo:101: 00000100:00100000:2.0:1787857050.040868:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.040902:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.040977:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025280 00000100:00100000:0.0:1787857050.040983:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025280 00000100:00100000:0.0:1787857050.041029:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787857050.041038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885025280:12345-0@lo:101: 00010000:00010000:0.0:1787857050.041049:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857050.041062:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe6d0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.041085:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.041096:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.041114:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045600, rc 0) 00000100:00100000:0.0:1787857050.041160:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025280:12345-0@lo:101: Request processed in 123us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.041167:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787857050.041248:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025280:0@lo:101: 00010000:00010000:2.0:1787857050.041261:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.041269:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857050.041460:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025408:0@lo:501: 00000100:00100000:2.0:1787857050.041488:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.041517:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857050.041615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025408 00000100:00100000:0.0:1787857050.041619:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025408 00000100:00100000:0.0:1787857050.041647:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787857050.041653:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025408:12345-0@lo:501: 00000100:00100000:0.0:1787857050.041887:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025408:12345-0@lo:501: Request processed in 232us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.041893:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787857050.041926:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025408:0@lo:501: 00000100:00100000:0.0:1787857050.041950:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025536:0@lo:503: 00000100:00100000:0.0:1787857050.041996:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.042008:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9584dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.042110:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025536 00000100:00100000:2.0:1787857050.042115:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025536 00000100:00100000:2.0:1787857050.042155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787857050.042162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025536:12345-0@lo:503: 00000100:00100000:2.0:1787857050.042387:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025536:12345-0@lo:503: Request processed in 224us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.042394:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787857050.042545:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025536:0@lo:503: 00000040:00080000:0.0:1787857050.042862:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787857050.042913:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025664:0@lo:502: 00000100:00100000:0.0:1787857050.042953:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.042973:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.043037:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025664 00000100:00100000:2.0:1787857050.043042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025664 00000100:00100000:2.0:1787857050.043076:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787857050.043084:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025664:12345-0@lo:502: 00000100:00100000:2.0:1787857050.043276:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025664:12345-0@lo:502: Request processed in 192us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.043284:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787857050.043399:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025664:0@lo:502: 00000040:00080000:0.0:1787857050.043907:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787857050.043957:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787857050.043989:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787857050.044052:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787857050.044087:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787857050.044244:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787857050.044283:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787857050.044388:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787857050.044432:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787857050.044535:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787857050.044566:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787857050.044609:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787857050.044641:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787857050.044719:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787857050.044765:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787857050.044793:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787857050.044818:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787857050.044855:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787857050.044886:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787857050.044913:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787857050.044970:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787857050.045005:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787857050.045033:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787857050.045074:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787857050.045108:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787857050.046232:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787857050.046419:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787857050.046532:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787857050.046570:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787857050.046637:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787857050.046829:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787857050.046864:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787857050.046893:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787857050.046939:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787857050.046973:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787857050.047013:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787857050.047056:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787857050.047101:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025792:0@lo:502: 00000100:00100000:0.0:1787857050.047189:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.047282:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.047331:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025792 00000100:00100000:2.0:1787857050.047339:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025792 00000100:00100000:2.0:1787857050.047393:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787857050.047402:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025792:12345-0@lo:502: 00000100:00100000:2.0:1787857050.047613:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885025792:12345-0@lo:502: Request processed in 212us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.047621:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787857050.047837:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885025792:0@lo:502: 00000040:00080000:0.0:1787857050.047912:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787857050.047922:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787857050.048448:0:7622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787857050.048464:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fd96d9b19d0) 00000020:00000080:3.0:1787857050.048487:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787857050.048569:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd975d01000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787857050.048573:0:7622:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd975d01000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787857050.048576:0:7622:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd975d01000 3 00010000:00080000:3.0:1787857050.048606:0:7622:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd96d9df800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.129@tcp at head 00010000:00010000:3.0:1787857050.050914:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787857050.051168:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787857050.051206:0:7622:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787857050.051217:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf326646fe3bbe6e5 00000100:00080000:3.0:1787857050.051227:0:7622:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787857050.051233:0:7622:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fd96d9df800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857050.051268:0:7622:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97b71e1c0 x1874703885025920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787857050.051294:0:7622:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787857050.051371:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885025920:0@lo:38: 00000100:00100000:1.0:1787857050.051533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.053112:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885025920 00000100:00100000:2.0:1787857050.053143:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885025920 00000100:00100000:2.0:1787857050.053197:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857050.053206:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885025920:12345-0@lo:38: 00010000:00080000:2.0:1787857050.053237:0:5836:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787857050.053274:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf326646fe3bbe6ec 00000004:00100000:2.0:1787857050.053289:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787857050.053323:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9fd84304d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857050.053407:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874703885025920:12345-0@lo:38: Request processed in 201us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.053414:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787857050.053560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd97b71e1c0 x1874703885025920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857050.053572:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787857050.053581:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787857050.053589:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787857050.053594:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787857050.053596:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787857050.053602:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885025920:0@lo:38: 00000040:00080000:3.0:1787857050.053999:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787857050.054227:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857050.054294:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885026176:0@lo:400: 00000100:00100000:0.0:1787857050.054340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.054365:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857050.054370:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885026304:0@lo:400: 00000100:00100000:0.0:1787857050.054392:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.054421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026176 00000100:00100000:0.0:1787857050.054425:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026176 00000100:00100000:0.0:1787857050.054466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857050.054474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885026176:12345-0@lo:400: 00000100:00100000:0.0:1787857050.054513:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885026176:12345-0@lo:400: Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.054519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857050.054538:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026304 00000100:00100000:0.0:1787857050.054542:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026304 00000100:00100000:0.0:1787857050.054565:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857050.054571:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885026304:12345-0@lo:400: 00000100:00100000:0.0:1787857050.054599:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885026304:12345-0@lo:400: Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.054604:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787857050.054618:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857050.054633:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787857050.054657:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a638000 x1874703885026304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857050.054684:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885026304:0@lo:400: 00010000:00080000:0.0:1787857050.054696:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a63b480 x1874703885026176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857050.054704:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885026176:0@lo:400: 00000020:01000000:0.0:1787857050.054733:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787857050.054758:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857050.054775:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857050.054785:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787857050.054858:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787857050.054861:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787857050.054863:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857050.054864:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857050.054865:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857050.054867:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857050.054868:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857050.054870:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787857050.054871:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787857050.054873:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857050.054874:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857050.054879:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787857050.054881:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787857050.054882:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787857050.054883:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857050.054884:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857050.054886:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857050.054893:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857050.054894:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857050.054895:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787857050.054895:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787857050.054896:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857050.054897:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857050.054912:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787857050.054923:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885026432:0@lo:253: 00000100:00100000:0.0:1787857050.054959:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857050.054982:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.055076:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026432 00000100:00100000:2.0:1787857050.055081:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026432 00000100:00100000:2.0:1787857050.055117:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787857050.055124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:7610:x1874703885026432:12345-0@lo:253: 20000000:01000000:2.0:1787857050.055153:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787857050.055165:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787857050.055791:0:7624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7624:1874703885026560:0@lo:901: 00000100:00100000:2.0:1787857050.055842:0:7624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.055886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026560 00000100:00100000:2.0:1787857050.055891:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026560 00000100:00100000:2.0:1787857050.055924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857050.055930:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7624:x1874703885026560:12345-0@lo:901: 00000100:00100000:2.0:1787857050.056194:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7624:x1874703885026560:12345-0@lo:901: Request processed in 262us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.056201:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857050.056221:0:7624:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41300 going to sleep for 11 seconds 00010000:00080000:2.0:1787857050.056239:0:7624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a4043c0 x1874703885026560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787857066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857050.056250:0:7624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7624:1874703885026560:0@lo:901: 00000100:00100000:3.0:1787857050.056545:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885026048:0@lo:400: 00000100:00100000:3.0:1787857050.056581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.056652:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026048 00000100:00100000:2.0:1787857050.056681:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026048 00000100:00100000:2.0:1787857050.056711:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787857050.056717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885026048:12345-0@lo:400: 00000100:00100000:2.0:1787857050.056756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885026048:12345-0@lo:400: Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.056762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787857050.056829:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd94a638f00 x1874703885026048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857050.056839:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885026048:0@lo:400: 00000100:00080000:0.0:1787857050.057214:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857050.057260:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787857050.076061:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787857050.076109:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787857050.077955:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787857050.077967:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787857050.077993:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078015:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078026:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078069:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078087:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857050.078103:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b5e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885026688:0@lo:104: 00000100:00100000:1.0:1787857050.078184:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857050.078241:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945615cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857050.078296:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026688 00000100:00100000:2.0:1787857050.078304:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026688 00000100:00100000:2.0:1787857050.078361:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787857050.078371:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885026688:12345-0@lo:104: 00010000:00010000:2.0:1787857050.078384:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857050.078457:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787857050.078464:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:5852:x1874703885026688:12345-0@lo:104: Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.078487:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787857050.078601:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857050.078608:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078616:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857050.078620:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078628:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857050.078637:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857050.078650:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857050.078709:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078717:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857050.078738:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078746:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe63d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe644 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078767:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857050.078769:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857050.078770:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857050.078782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885026816:0@lo:103: 00000100:00100000:1.0:1787857050.078818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857050.078855:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026816 00000100:00100000:1.0:1787857050.078860:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026816 00010000:00010000:1.0:1787857050.078880:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 15 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857050.078901:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857050.078908:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:3309:x1874703885026816:12345-0@lo:103: 00010000:00010000:1.0:1787857050.078920:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857050.078926:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 15 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078936:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 15 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078960:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078969:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787857050.078982:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002144948s 00010000:00010000:1.0:1787857050.078987:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.078995:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079003:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079010:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079016:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857050.079020:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079029:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079038:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079049:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857050.079079:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:3309:x1874703885026816:12345-0@lo:103: Request processed in 171us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857050.079092:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857050.079176:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885026816:0@lo:103: 00010000:00010000:1.0:1787857050.079202:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031e00/0xf326646fe3bbe644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe63d expref: 14 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857050.079212:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b5e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1874703885026688:0@lo:104: 00010000:00010000:1.0:1787857050.079224:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079232:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079238:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857050.079245:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953489e00/0xf326646fe3bbe6f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857050.086625:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:7610:x1874703885026432:12345-0@lo:253: Request processed in 31492us (31656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857050.086643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787857050.086804:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:77122e39-57f8-4b24-9fe4-5b00eda54f16:7610:1874703885026432:0@lo:253: 10000000:01000000:1.0:1787857050.086822:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787857050.086825:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787857050.086827:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787857050.086828:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787857050.086830:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787857050.086831:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787857050.086832:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787857050.086834:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787857050.086835:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787857050.086836:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787857050.086838:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787857050.086840:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787857050.086871:0:7610:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787857050.090104:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857050.090270:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787857050.090432:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857050.090628:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787857050.090891:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787857050.091080:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787857050.093342:0:7610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787857050.282604:0:7610:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787857050.282614:0:7610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787857050.282653:0:7610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787857050.282799:0:7610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787857050.282814:0:7610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787857050.282845:0:7610:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787857050.440103:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885026944:0@lo:13: 00000100:00100000:1.0:1787857050.440191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857050.440302:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885026944 00000100:00100000:2.0:1787857050.440309:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885026944 00000100:00100000:2.0:1787857050.440362:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857050.440372:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885026944:12345-0@lo:13: 00002000:00000024:2.0:1787857050.440407:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857050.440455:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885026944:12345-0@lo:13: Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857050.440462:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787857050.440508:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4043c0 x1874703885026944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857050.440691:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885026944:0@lo:13: 00010000:00010000:0.0:1787857051.100085:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857052.109763:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857053.127936:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857054.156069:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857055.185788:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857055.561258:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885027456:0@lo:400: 00000100:00100000:1.0:1787857055.561335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857055.561389:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857055.561396:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885027328:0@lo:400: 00000100:00100000:1.0:1787857055.561420:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857055.561585:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885027072:0@lo:400: 00000100:00100000:0.0:1787857055.561622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857055.561655:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885027584:0@lo:400: 00000100:00100000:0.0:1787857055.561701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857055.561721:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857055.561726:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885027200:0@lo:400: 00000100:00100000:0.0:1787857055.561746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857055.561788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027328 00000100:00100000:0.0:1787857055.561795:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027328 00000100:00100000:0.0:1787857055.561839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027584 00000100:00100000:0.0:1787857055.561842:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027584 00000100:00100000:0.0:1787857055.561855:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027200 00000100:00100000:0.0:1787857055.561857:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027200 00000100:00100000:0.0:1787857055.561870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857055.561878:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885027328:12345-0@lo:400: 00000100:00100000:0.0:1787857055.561930:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885027328:12345-0@lo:400: Request processed in 52us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857055.561938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857055.561965:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857055.561976:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885027584:12345-0@lo:400: 00000100:00100000:0.0:1787857055.562013:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885027584:12345-0@lo:400: Request processed in 41us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857055.562019:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787857055.562106:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027456 00000100:00100000:3.0:1787857055.562114:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027456 00000100:00100000:3.0:1787857055.562146:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857055.562153:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885027456:12345-0@lo:400: 00000100:00100000:3.0:1787857055.562189:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885027456:12345-0@lo:400: Request processed in 37us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857055.562196:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857055.563706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787857055.563724:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a6392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885027200:12345-0@lo:400: 00000100:00100000:0.0:1787857055.563790:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a6392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885027200:12345-0@lo:400: Request processed in 73us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857055.563798:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787857055.563831:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857055.563836:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787857055.563905:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b61c0 x1874703885027200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857055.563921:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885027200:0@lo:400: 00010000:00080000:0.0:1787857055.563934:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b7840 x1874703885027584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857055.563955:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885027584:0@lo:400: 00010000:00080000:0.0:1787857055.563995:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b52c0 x1874703885027328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857055.564005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885027328:0@lo:400: 00010000:00080000:0.0:1787857055.564015:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b5680 x1874703885027456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857055.564023:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885027456:0@lo:400: 00000100:00100000:1.0:1787857055.564265:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027072 00000100:00100000:1.0:1787857055.564271:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027072 00000100:00100000:1.0:1787857055.564315:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787857055.564323:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3311:x1874703885027072:12345-0@lo:400: 00000100:00100000:1.0:1787857055.564373:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3311:x1874703885027072:12345-0@lo:400: Request processed in 53us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857055.564379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787857055.566064:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885027712:0@lo:13: 00000100:00100000:3.0:1787857055.566123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857055.566646:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885027072:0@lo:400: 00000100:00100000:1.0:1787857055.570725:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027712 00000100:00100000:1.0:1787857055.570809:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027712 00000100:00100000:1.0:1787857055.570869:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787857055.570914:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885027712:12345-0@lo:13: 00002000:00000024:1.0:1787857055.570954:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857055.571118:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885027712:12345-0@lo:13: Request processed in 234us (4993us total) trans 0 rc 0/0 00010000:00080000:0.0:1787857055.572255:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b7c00 x1874703885027712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857055.572278:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885027712:0@lo:13: 00000100:00100000:1.0:1787857055.573202:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787857056.210768:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857056.607574:0:7965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787857057.225725:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857058.247905:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857059.272163:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787857059.655798:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787857059.655809:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd950737800 from 30 10000000:01000000:2.0:1787857059.655815:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857059.655868:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.655882:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.655894:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.655939:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885027840:0@lo:101: 00000100:00100000:2.0:1787857059.656022:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.656112:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.656295:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027840 00000100:00100000:0.0:1787857059.656303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027840 00000100:00100000:0.0:1787857059.656355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787857059.656365:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885027840:12345-0@lo:101: 00010000:00010000:0.0:1787857059.656377:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857059.656391:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe6fa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.656427:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.656440:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.656463:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045e00, rc 0) 00000100:00100000:0.0:1787857059.656525:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885027840:12345-0@lo:101: Request processed in 161us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.656534:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787857059.656540:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885027840:0@lo:101: 00010000:00010000:2.0:1787857059.656559:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.656573:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.656623:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885027968:0@lo:501: 00000100:00100000:2.0:1787857059.656680:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.656708:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857059.656955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885027968 00000100:00100000:1.0:1787857059.656961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885027968 00000100:00100000:1.0:1787857059.656994:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787857059.657002:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885027968:12345-0@lo:501: 00000100:00100000:1.0:1787857059.657394:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885027968:12345-0@lo:501: Request processed in 392us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857059.657404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787857059.657621:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885027968:0@lo:501: 00000100:00100000:2.0:1787857059.657656:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028096:0@lo:503: 00000100:00100000:2.0:1787857059.657719:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.657749:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.658220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028096 00000100:00100000:0.0:1787857059.658227:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028096 00000100:00100000:0.0:1787857059.658258:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787857059.658265:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885028096:12345-0@lo:503: 00000100:00100000:0.0:1787857059.658579:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885028096:12345-0@lo:503: Request processed in 313us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.658585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787857059.658649:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028096:0@lo:503: 00000100:00100000:0.0:1787857059.658845:0:8069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8069:1874703885028224:0@lo:502: 00000100:00100000:0.0:1787857059.658884:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.658907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028224 00000100:00100000:0.0:1787857059.658910:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028224 00000100:00100000:0.0:1787857059.658933:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787857059.658939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8069:x1874703885028224:12345-0@lo:502: 00000100:00100000:1.0:1787857059.659039:0:8069:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.659176:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8069:x1874703885028224:12345-0@lo:502: Request processed in 236us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.659182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787857059.659975:0:8069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8069:1874703885028224:0@lo:502: 00000100:00100000:1.0:1787857059.660030:0:8069:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8069:1874703885028352:0@lo:502: 00000100:00100000:1.0:1787857059.660078:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857059.660105:0:8069:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.660484:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028352 00000100:00100000:0.0:1787857059.660490:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028352 00000100:00100000:0.0:1787857059.660536:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787857059.660545:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8069:x1874703885028352:12345-0@lo:502: 00000100:00100000:0.0:1787857059.661859:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8069:x1874703885028352:12345-0@lo:502: Request processed in 1309us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.661870:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787857059.661993:0:8069:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8069:1874703885028352:0@lo:502: 00000040:00080000:2.0:1787857059.662025:0:8069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787857059.662283:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787857059.662303:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857059.662313:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.662335:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857059.662346:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787857059.662350:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787857059.662353:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857059.662386:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.662395:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.662405:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857059.662426:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028480:0@lo:101: 00000100:00100000:0.0:1787857059.662472:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.662514:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.662626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028480 00000100:00100000:3.0:1787857059.662633:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028480 00000100:00100000:3.0:1787857059.662713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787857059.662722:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885028480:12345-0@lo:101: 00010000:00010000:3.0:1787857059.662734:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857059.662746:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe708 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.662769:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.662780:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.662789:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d400, rc 0) 00000100:00100000:3.0:1787857059.662826:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885028480:12345-0@lo:101: Request processed in 105us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.662833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787857059.662877:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028480:0@lo:101: 00010000:00010000:3.0:1787857059.662891:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.662900:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857059.662958:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028608:0@lo:501: 00000100:00100000:3.0:1787857059.662984:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.663005:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.663017:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028608 00000100:00100000:3.0:1787857059.663021:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028608 00000100:00100000:3.0:1787857059.663044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787857059.663050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885028608:12345-0@lo:501: 00000100:00100000:3.0:1787857059.663307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885028608:12345-0@lo:501: Request processed in 255us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.663314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787857059.663544:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028608:0@lo:501: 00000100:00100000:3.0:1787857059.663573:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028736:0@lo:503: 00000100:00100000:3.0:1787857059.663612:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.663627:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01000 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.663651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028736 00000100:00100000:3.0:1787857059.663654:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028736 00000100:00100000:3.0:1787857059.663700:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787857059.663706:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885028736:12345-0@lo:503: 00000100:00100000:3.0:1787857059.663980:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885028736:12345-0@lo:503: Request processed in 273us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.663994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787857059.664026:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885028736:0@lo:503: 00000100:00100000:3.0:1787857059.664189:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8070:1874703885028864:0@lo:502: 00000100:00100000:3.0:1787857059.664223:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.664243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028864 00000100:00100000:3.0:1787857059.664247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028864 00000100:00100000:3.0:1787857059.664267:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787857059.664273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8070:x1874703885028864:12345-0@lo:502: 00000100:00100000:3.0:1787857059.664875:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8070:x1874703885028864:12345-0@lo:502: Request processed in 600us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.664882:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787857059.664925:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.665199:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8070:1874703885028864:0@lo:502: 00000020:01000000:3.0:1787857059.665225:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857059.665234:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857059.665236:0:8070:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787857059.665242:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787857059.665244:0:8070:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787857059.665444:0:8070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8070:1874703885028992:0@lo:502: 00000100:00100000:3.0:1787857059.665488:0:8070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.665516:0:8070:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.665568:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885028992 00000100:00100000:0.0:1787857059.665573:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885028992 00000100:00100000:0.0:1787857059.665611:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787857059.665619:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8070:x1874703885028992:12345-0@lo:502: 00000100:00100000:0.0:1787857059.665823:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8070:x1874703885028992:12345-0@lo:502: Request processed in 205us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.665830:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787857059.665999:0:8070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8070:1874703885028992:0@lo:502: 00000020:01000000:2.0:1787857059.666019:0:8070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857059.666023:0:8070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857059.666025:0:8070:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787857059.666029:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787857059.666415:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787857059.666434:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787857059.666444:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.666456:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857059.666466:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787857059.666469:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96116a000 from 30 10000000:01000000:0.0:1787857059.666472:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787857059.666497:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.666506:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.666516:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857059.666531:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029120:0@lo:101: 00000100:00100000:0.0:1787857059.666566:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.666603:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.666993:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029120 00000100:00100000:3.0:1787857059.667000:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029120 00000100:00100000:3.0:1787857059.667039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787857059.667047:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885029120:12345-0@lo:101: 00010000:00010000:3.0:1787857059.667057:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857059.667079:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe716 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.668833:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.668862:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.668872:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:3.0:1787857059.669222:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029120:12345-0@lo:101: Request processed in 2174us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.669230:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787857059.669518:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029120:0@lo:101: 00010000:00010000:0.0:1787857059.669539:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.669566:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857059.669652:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029248:0@lo:501: 00000100:00100000:0.0:1787857059.669704:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.669735:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.669752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029248 00000100:00100000:0.0:1787857059.669757:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029248 00000100:00100000:0.0:1787857059.669787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787857059.669794:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029248:12345-0@lo:501: 00000100:00100000:0.0:1787857059.670059:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029248:12345-0@lo:501: Request processed in 264us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.670066:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787857059.670095:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029248:0@lo:501: 00000100:00100000:0.0:1787857059.670772:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029376:0@lo:503: 00000100:00100000:0.0:1787857059.670835:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.670986:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857059.672187:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029376 00000100:00100000:2.0:1787857059.672198:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029376 00000100:00100000:2.0:1787857059.672301:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787857059.672311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029376:12345-0@lo:503: 00000100:00100000:2.0:1787857059.672682:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029376:12345-0@lo:503: Request processed in 352us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857059.672697:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787857059.672786:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029376:0@lo:503: 00000100:00100000:0.0:1787857059.673510:0:8071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8071:1874703885029504:0@lo:502: 00000100:00100000:0.0:1787857059.673566:0:8071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.673880:0:8071:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca840 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.674008:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029504 00000100:00100000:3.0:1787857059.674015:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029504 00000100:00100000:3.0:1787857059.674049:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787857059.674057:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8071:x1874703885029504:12345-0@lo:502: 00000100:00100000:3.0:1787857059.674517:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8071:x1874703885029504:12345-0@lo:502: Request processed in 458us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.674526:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787857059.674622:0:8071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8071:1874703885029504:0@lo:502: 00000100:00100000:0.0:1787857059.674840:0:8071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8071:1874703885029632:0@lo:502: 00000100:00100000:0.0:1787857059.674889:0:8071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.674922:0:8071:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8425ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857059.675034:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029632 00000100:00100000:2.0:1787857059.675039:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029632 00000100:00100000:2.0:1787857059.675074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787857059.675081:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8071:x1874703885029632:12345-0@lo:502: 00000100:00100000:2.0:1787857059.675475:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8071:x1874703885029632:12345-0@lo:502: Request processed in 393us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857059.675482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787857059.675563:0:8071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8071:1874703885029632:0@lo:502: 00000040:00080000:0.0:1787857059.675585:0:8071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787857059.675969:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787857059.675991:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787857059.676001:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.676013:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857059.676022:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787857059.676025:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96116a000 from 5 10000000:01000000:2.0:1787857059.676028:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787857059.676058:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.676067:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.676077:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.676093:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029760:0@lo:101: 00000100:00100000:2.0:1787857059.676152:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.676436:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857059.676494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029760 00000100:00100000:1.0:1787857059.676500:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029760 00000100:00100000:3.0:1787857059.676552:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787857059.676563:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885029760:12345-0@lo:101: 00010000:00010000:3.0:1787857059.676574:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857059.676590:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe72b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe724 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.676616:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe724 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.676656:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe72b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe724 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857059.676689:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d800, rc 0) 00000100:00100000:3.0:1787857059.676732:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885029760:12345-0@lo:101: Request processed in 172us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.676738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787857059.676900:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029760:0@lo:101: 00010000:00010000:2.0:1787857059.676913:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.676922:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.676989:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029888:0@lo:256: 00000100:00100000:2.0:1787857059.677025:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.677052:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.677214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885029888 00000100:00100000:0.0:1787857059.677219:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885029888 00000100:00100000:0.0:1787857059.677244:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787857059.677250:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885029888:12345-0@lo:256: 20000000:01000000:0.0:1787857059.677277:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787857059.677293:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787857059.677297:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787857059.677496:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885029888:12345-0@lo:256: Request processed in 246us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.677504:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787857059.677565:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885029888:0@lo:256: 10000000:01000000:2.0:1787857059.677606:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787857059.677613:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.677621:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857059.677630:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787857059.677632:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787857059.677634:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787857059.677686:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.677695:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.677714:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.677726:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030016:0@lo:101: 00000100:00100000:2.0:1787857059.677753:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.677774:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.677882:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030016 00000100:00100000:0.0:1787857059.677886:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030016 00000100:00100000:0.0:1787857059.677905:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787857059.677911:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885030016:12345-0@lo:101: 00010000:00010000:0.0:1787857059.677920:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857059.677930:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe732 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.677966:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.677976:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857059.677985:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045400, rc 0) 00000100:00100000:0.0:1787857059.678025:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885030016:12345-0@lo:101: Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.678031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787857059.678198:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030016:0@lo:101: 00010000:00010000:2.0:1787857059.678209:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.678217:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.678393:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030144:0@lo:501: 00000100:00100000:2.0:1787857059.678421:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.678444:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.678500:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030144 00000100:00100000:3.0:1787857059.678505:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030144 00000100:00100000:3.0:1787857059.678528:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787857059.678534:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885030144:12345-0@lo:501: 00000100:00100000:3.0:1787857059.678819:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885030144:12345-0@lo:501: Request processed in 284us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.678825:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787857059.678993:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030144:0@lo:501: 00000100:00100000:2.0:1787857059.679022:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030272:0@lo:503: 00000100:00100000:2.0:1787857059.679063:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.679093:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.679386:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030272 00000100:00100000:3.0:1787857059.679390:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030272 00000100:00100000:3.0:1787857059.679412:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787857059.679418:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885030272:12345-0@lo:503: 00000100:00100000:3.0:1787857059.681461:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885030272:12345-0@lo:503: Request processed in 2036us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.681473:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787857059.681590:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885030272:0@lo:503: 00000100:00100000:2.0:1787857059.682856:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8072:1874703885030400:0@lo:502: 00000100:00100000:2.0:1787857059.682929:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.683073:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857059.683173:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030400 00000100:00100000:0.0:1787857059.683180:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030400 00000100:00100000:0.0:1787857059.683269:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787857059.683280:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8072:x1874703885030400:12345-0@lo:502: 00000100:00100000:0.0:1787857059.683792:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8072:x1874703885030400:12345-0@lo:502: Request processed in 510us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.683802:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787857059.683900:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8072:1874703885030400:0@lo:502: 00000020:01000000:2.0:1787857059.683959:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787857059.683967:0:8072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787857059.683974:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857059.683977:0:8072:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787857059.683982:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787857059.683986:0:8072:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:2.0:1787857059.684008:0:8072:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787857059.684012:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787857059.684027:0:8072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fd96db8b3a0) 00000020:00000080:2.0:1787857059.684051:0:8072:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787857059.684057:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787857059.684161:0:8072:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787857059.684166:0:8072:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787857059.684173:0:8072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbe747 00010000:00080000:2.0:1787857059.684211:0:8072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd96d9db800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1787857059.684840:0:8072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787857059.685250:0:8072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787857059.685485:0:8072:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787857059.686926:0:8072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857059.687549:0:8072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857059.687602:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787857059.687864:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787857059.688523:0:8073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857059.688528:0:8073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787857059.689602:0:8072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787857059.689614:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787857059.689867:0:8072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787857059.689892:0:8072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbe74e 00000100:00080000:2.0:1787857059.689902:0:8072:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787857059.689908:0:8072:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96d9db800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857059.690025:0:8072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd94a407c00 x1874703885030528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787857059.690190:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885030528:0@lo:8: 00000100:00100000:1.0:1787857059.690417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787857059.690522:0:8072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787857059.690593:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857059.690598:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857059.690601:0:8072:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787857059.690603:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857059.690607:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857059.690609:0:8072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787857059.690612:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787857059.690614:0:8072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787857059.690653:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8072:1874703885030656:0@lo:502: 00000100:00100000:2.0:1787857059.690725:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.690757:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030656 00000100:00100000:2.0:1787857059.690763:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030656 00000100:00100000:2.0:1787857059.690808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787857059.690817:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8072:x1874703885030656:12345-0@lo:502: 00000100:00100000:2.0:1787857059.691083:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8072:x1874703885030656:12345-0@lo:502: Request processed in 266us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857059.691091:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787857059.691149:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857059.691168:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8072:1874703885030656:0@lo:502: 00000020:01000000:2.0:1787857059.691191:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857059.691196:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857059.691197:0:8072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787857059.691201:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1787857059.691441:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885030784:0@lo:400: 00000100:00100000:3.0:1787857059.691476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.691498:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857059.691504:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885030912:0@lo:400: 00000100:00100000:3.0:1787857059.691526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.691569:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885031040:0@lo:400: 00000100:00100000:3.0:1787857059.691597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787857059.692488:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787857059.692513:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787857059.692524:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857059.692544:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857059.692555:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787857059.692558:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fd942e119d0 from 1 10000000:01000000:1.0:1787857059.692561:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787857059.692590:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857059.692597:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857059.692605:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857059.692621:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885031296:0@lo:101: 00000100:00100000:1.0:1787857059.692702:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857059.692736:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787857059.692759:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885031168:0@lo:400: 00000100:00100000:1.0:1787857059.692786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857059.692825:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030784 00000100:00100000:1.0:1787857059.692831:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030784 00000100:00100000:1.0:1787857059.692862:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030912 00000100:00100000:1.0:1787857059.692865:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030912 00000100:00100000:1.0:1787857059.692889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031168 00000100:00100000:1.0:1787857059.692892:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031168 00000100:00100000:1.0:1787857059.692906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857059.692914:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885030784:12345-0@lo:400: 00000100:00100000:3.0:1787857059.693784:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857059.693796:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787857059.693813:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857059.693823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787857059.693833:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885030912:12345-0@lo:400: 00000100:00100000:3.0:1787857059.693890:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885030912:12345-0@lo:400: Request processed in 60us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.693897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787857059.693914:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787857059.693920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787857059.693926:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885031168:12345-0@lo:400: 00000100:00100000:3.0:1787857059.694051:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885031168:12345-0@lo:400: Request processed in 124us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.694058:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857059.694162:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885030784:12345-0@lo:400: Request processed in 1247us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857059.694170:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787857059.694202:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787857059.694587:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71d2c0 x1874703885030912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857059.694603:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885030912:0@lo:400: 00010000:00080000:1.0:1787857059.694616:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71cb40 x1874703885030784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857059.694625:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885030784:0@lo:400: 00010000:00080000:1.0:1787857059.694705:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71de00 x1874703885031168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857059.694715:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885031168:0@lo:400: 00000100:00100000:2.0:1787857059.694824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031296 00000100:00100000:2.0:1787857059.694832:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031296 00000100:00100000:2.0:1787857059.694869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787857059.694877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885031296:12345-0@lo:101: 00010000:00010000:2.0:1787857059.694898:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857059.694916:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe755 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.694959:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.694970:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.694980:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a200, rc 0) 00000100:00100000:2.0:1787857059.695026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885031296:12345-0@lo:101: Request processed in 150us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857059.695032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787857059.695070:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885031296:0@lo:101: 00010000:00010000:2.0:1787857059.695086:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.695095:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857059.695169:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885031424:0@lo:501: 00000100:00100000:2.0:1787857059.695199:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857059.695226:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857059.695239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031424 00000100:00100000:2.0:1787857059.695242:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031424 00000100:00100000:2.0:1787857059.695277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787857059.695284:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885031424:12345-0@lo:501: 00000100:00100000:2.0:1787857059.695799:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885031424:12345-0@lo:501: Request processed in 514us (598us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857059.695806:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787857059.695839:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885031424:0@lo:501: 10000000:01000000:2.0:1787857059.695868:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787857059.695876:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857059.695884:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857059.696452:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885030528 00000100:00100000:0.0:1787857059.696460:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885030528 00000100:00100000:0.0:1787857059.696502:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031040 00000100:00100000:0.0:1787857059.696505:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031040 00000100:00100000:0.0:1787857059.696540:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857059.696548:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885031040:12345-0@lo:400: 00000100:00100000:0.0:1787857059.696605:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885031040:12345-0@lo:400: Request processed in 58us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.696612:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857059.696627:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857059.696631:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1874703885030528:12345-0@lo:8: 00010000:00080000:0.0:1787857059.696680:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1787857059.696707:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbe763 00002000:00100000:0.0:1787857059.696719:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fd975787000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787857059.696724:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787857059.696736:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787857059.697426:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787857059.697590:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787857059.697616:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9fd975781000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787857059.697767:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874703885030528:12345-0@lo:8: Request processed in 1133us (7349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857059.697776:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787857059.697818:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787857059.697872:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a407c00 x1874703885030528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857059.697883:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787857059.697891:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787857059.697899:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787857059.697905:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787857059.697907:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9db800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787857059.697922:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787857059.697927:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885030528:0@lo:8: 00000004:00080000:0.0:1787857059.698224:0:8073:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787857059.698464:0:8073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214026802884ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787857059.699733:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71d680 x1874703885031040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857059.699748:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885031040:0@lo:400: 00000004:00080000:3.0:1787857059.763111:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787857059.763213:0:8074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787857059.763242:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031680:0@lo:7: 00000100:00100000:3.0:1787857059.763325:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.763382:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.763398:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885031552:0@lo:13: 00000100:00100000:3.0:1787857059.763421:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857059.763468:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031680 00000100:00100000:3.0:1787857059.763474:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031680 00000100:00100000:3.0:1787857059.763521:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857059.763530:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8074:x1874703885031680:12345-0@lo:7: 00000100:00080000:2.0:1787857059.768819:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857059.769292:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031552 00000100:00100000:2.0:1787857059.769303:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031552 00000100:00100000:2.0:1787857059.769367:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787857059.769378:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874703885031552:12345-0@lo:13: 00002000:00000024:2.0:1787857059.769408:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787857059.769525:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874703885031552:12345-0@lo:13: Request processed in 141us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857059.769532:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787857059.769569:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71d680 x1874703885031552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857059.769592:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885031552:0@lo:13: 00002000:00080000:3.0:1787857059.773505:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787857059.773589:0:6679:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00010000:00080000:0.0:1787857059.777593:0:8074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71c000 x1874703885031680/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787857075 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857059.777615:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031680:0@lo:7: 00000004:00080000:0.0:1787857059.777645:0:8074:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787857059.777910:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031808:0@lo:5: 00000100:00100000:0.0:1787857059.779975:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.780102:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945615000 going to sleep for 11 seconds 00000100:00100000:1.0:1787857059.780206:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787857059.780216:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787857059.780240:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8074:x1874703885031680:12345-0@lo:7: Request processed in 16709us (16913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857059.780251:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787857059.780279:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031808 00000100:00100000:3.0:1787857059.780287:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031808 00000100:00100000:3.0:1787857059.780322:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787857059.780329:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a639680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8074:x1874703885031808:12345-0@lo:5: 00002000:00080000:3.0:1787857059.780356:0:6679:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787857059.780359:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787857059.780754:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a639680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8074:x1874703885031808:12345-0@lo:5: Request processed in 424us (784us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787857059.780761:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787857059.780935:0:8074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a638000 x1874703885031808/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857075 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857059.780962:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031808:0@lo:5: 00000004:00080000:1.0:1787857059.780974:0:8074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787857059.781010:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031936:0@lo:700: 00000100:00100000:1.0:1787857059.781060:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857059.781089:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857059.783596:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885031936 00000100:00100000:3.0:1787857059.783610:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885031936 00000100:00100000:0.0:1787857059.784063:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857059.784090:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8074:x1874703885031936:12345-0@lo:700: 00000100:00100000:0.0:1787857059.784153:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1874703885032064:0@lo:700: 00000100:00100000:0.0:1787857059.784276:0:6686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857059.784355:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945615480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857059.784408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032064 00000100:00100000:2.0:1787857059.784413:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032064 00000100:00100000:2.0:1787857059.784490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857059.784499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1874703885032064:12345-0@lo:700: 40000000:02000000:1.0:1787857059.846786:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787857059.860233:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1874703885032064:12345-0@lo:700: Request processed in 75726us (75947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857059.860263:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787857059.860527:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a63b480 x1874703885032064/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787857075 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857059.860542:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1874703885032064:0@lo:700: 40000000:02000000:2.0:1787857059.860566:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787857060.035988:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787857060.036009:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787857060.036203:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8074:x1874703885031936:12345-0@lo:700: Request processed in 252113us (255138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857060.036216:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787857060.041492:0:8074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b4780 x1874703885031936/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787857075 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857060.041508:0:8074:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787857060.041528:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885031936:0@lo:700: 00000004:02000040:1.0:1787857060.105214:0:8074:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787857060.110812:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885032192:0@lo:5: 00000100:00100000:0.0:1787857060.110893:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857060.110962:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd950739d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787857060.110981:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032192 00000100:00100000:1.0:1787857060.110989:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032192 00000100:00100000:1.0:1787857060.111048:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857060.111057:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8074:x1874703885032192:12345-0@lo:5: 00002000:00080000:0.0:1787857060.121393:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787857060.121418:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787857060.124680:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8074:x1874703885032192:12345-0@lo:5: Request processed in 13595us (13757us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787857060.124693:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787857060.126151:0:8074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a6383c0 x1874703885032192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787857076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857060.126174:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a6383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8074:1874703885032192:0@lo:5: 00000004:00080000:2.0:1787857060.126267:0:8074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787857060.298154:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857060.684212:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857060.685088:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885032320:0@lo:13: 00000100:00100000:1.0:1787857060.685167:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857060.685328:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032320 00000100:00100000:1.0:1787857060.685337:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032320 00000100:00100000:1.0:1787857060.685393:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857060.685403:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885032320:12345-0@lo:13: 00002000:00000024:1.0:1787857060.685448:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857060.685505:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885032320:12345-0@lo:13: Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857060.685512:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787857060.685551:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b4780 x1874703885032320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857060.685570:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885032320:0@lo:13: 00010000:00010000:1.0:1787857061.319945:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787857062.088343:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787857062.352532:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857063.367996:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857063.777620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.777853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989184 00000100:00100000:1.0:1787857063.777864:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989184 00000100:00100000:1.0:1787857063.777934:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:1.0:1787857063.777944:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1874703862989184:12345-192.168.204.29@tcp:250: 00010000:00080000:1.0:1787857063.777976:0:5831:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from f2987e7f-14a3-4148-a584-48f35ac5eb2c@192.168.204.29@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1787857063.778009:0:5831:0:(genops.c:1385:class_connect()) connect: client f2987e7f-14a3-4148-a584-48f35ac5eb2c, cookie 0xf326646fe3bbe76a 00000100:00080000:0.0:1787857063.780363:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9fd981e92800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787857063.780485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+5:2351:x1874703862989184:12345-192.168.204.29@tcp:250: Request processed in 2537us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857063.780497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:0.0:1787857063.786065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.786160:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989056 00000100:00100000:1.0:1787857063.786171:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989056 00000100:00100000:1.0:1787857063.786253:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:1.0:1787857063.786264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+5:5580:x1874703862989056:12345-192.168.204.29@tcp:101: 00010000:00010000:1.0:1787857063.786282:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857063.786302:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8826ff expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.786331:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.786343:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.786372:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489600, rc 0) 00000100:00100000:1.0:1787857063.786717:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+6:5580:x1874703862989056:12345-192.168.204.29@tcp:101: Request processed in 453us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857063.786725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:3.0:1787857063.790928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.791104:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989312 00000100:00100000:0.0:1787857063.791115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989312 00000100:00100000:0.0:1787857063.791188:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:0.0:1787857063.791199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+6:5580:x1874703862989312:12345-192.168.204.29@tcp:501: 00000100:00100000:0.0:1787857063.791704:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+6:5580:x1874703862989312:12345-192.168.204.29@tcp:501: Request processed in 504us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857063.791713:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:3.0:1787857063.801682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857063.801785:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989440 00000100:00100000:2.0:1787857063.801797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989440 00000100:00100000:2.0:1787857063.801885:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:2.0:1787857063.801897:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+6:5580:x1874703862989440:12345-192.168.204.29@tcp:101: 00010000:00010000:2.0:1787857063.801916:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857063.801935:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882706 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.801964:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.801977:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.801986:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b200, rc 0) 00000100:00100000:2.0:1787857063.802058:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+7:5580:x1874703862989440:12345-192.168.204.29@tcp:101: Request processed in 163us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857063.802064:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:3.0:1787857063.805883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.806026:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989568 00000100:00100000:1.0:1787857063.806035:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989568 00000100:00100000:1.0:1787857063.806088:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:1.0:1787857063.806096:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+7:5580:x1874703862989568:12345-192.168.204.29@tcp:501: 00000100:00100000:1.0:1787857063.806617:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5580:x1874703862989568:12345-192.168.204.29@tcp:501: Request processed in 520us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857063.806625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1787857063.816075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.818857:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989696 00000100:00100000:0.0:1787857063.818951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989696 00000100:00100000:0.0:1787857063.819018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1787857063.819027:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5580:x1874703862989696:12345-192.168.204.29@tcp:503: 00000100:00100000:0.0:1787857063.819446:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5580:x1874703862989696:12345-192.168.204.29@tcp:503: Request processed in 418us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857063.819455:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:3.0:1787857063.839278:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857063.839744:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989824 00000100:00100000:2.0:1787857063.839755:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989824 00000100:00100000:2.0:1787857063.840043:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:2.0:1787857063.840054:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5599:x1874703862989824:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1787857063.840528:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5599:x1874703862989824:12345-192.168.204.29@tcp:502: Request processed in 474us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857063.840537:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:3.0:1787857063.880028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.880582:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862989952 00000100:00100000:1.0:1787857063.880592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862989952 00000100:00100000:1.0:1787857063.880654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:1.0:1787857063.880693:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5599:x1874703862989952:12345-192.168.204.29@tcp:502: 00000100:00100000:1.0:1787857063.881033:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5599:x1874703862989952:12345-192.168.204.29@tcp:502: Request processed in 342us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857063.881042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:3.0:1787857063.885199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857063.885353:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990080 00000100:00100000:2.0:1787857063.885363:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990080 00000100:00100000:2.0:1787857063.885423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:2.0:1787857063.885433:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5580:x1874703862990080:12345-192.168.204.29@tcp:101: 00010000:00010000:2.0:1787857063.885451:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857063.885471:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b800/0xf326646fe3bbe77f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882730 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.885503:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b800/0xf326646fe3bbe77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882730 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.885526:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b800/0xf326646fe3bbe77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882730 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857063.885536:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b800, rc 0) 00000100:00100000:2.0:1787857063.885601:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5580:x1874703862990080:12345-192.168.204.29@tcp:101: Request processed in 169us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857063.885607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:3.0:1787857063.890591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.890708:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990208 00000100:00100000:0.0:1787857063.890720:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990208 00000100:00100000:0.0:1787857063.890785:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:0.0:1787857063.890796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5580:x1874703862990208:12345-192.168.204.29@tcp:256: 20000000:01000000:0.0:1787857063.890826:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787857063.890861:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787857063.890877:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787857063.890880:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787857063.890883:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787857063.904861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5580:x1874703862990208:12345-192.168.204.29@tcp:256: Request processed in 14053us (14267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857063.904887:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:3.0:1787857063.915418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.915812:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990336 00000100:00100000:1.0:1787857063.915824:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990336 00000100:00100000:1.0:1787857063.915903:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1787857063.915914:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5580:x1874703862990336:12345-192.168.204.29@tcp:101: 00010000:00010000:1.0:1787857063.915931:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857063.916179:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882737 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.916224:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.916250:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857063.916261:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489c00, rc 0) 00000100:00100000:1.0:1787857063.916330:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5580:x1874703862990336:12345-192.168.204.29@tcp:101: Request processed in 418us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857063.916337:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:3.0:1787857063.919371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.920280:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990464 00000100:00100000:0.0:1787857063.920291:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990464 00000100:00100000:0.0:1787857063.920349:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:0.0:1787857063.920358:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5580:x1874703862990464:12345-192.168.204.29@tcp:501: 00000100:00100000:0.0:1787857063.920656:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5580:x1874703862990464:12345-192.168.204.29@tcp:501: Request processed in 298us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857063.921227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:3.0:1787857063.926862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857063.927103:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990592 00000100:00100000:1.0:1787857063.927114:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990592 00000100:00100000:1.0:1787857063.927186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:1.0:1787857063.927196:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5580:x1874703862990592:12345-192.168.204.29@tcp:503: 00000100:00100000:1.0:1787857063.927604:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5580:x1874703862990592:12345-192.168.204.29@tcp:503: Request processed in 407us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857063.927612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:3.0:1787857063.933920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.934622:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990720 00000100:00100000:0.0:1787857063.934648:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990720 00000100:00100000:0.0:1787857063.934752:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:0.0:1787857063.934762:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5605:x1874703862990720:12345-192.168.204.29@tcp:502: 00000100:00100000:0.0:1787857063.935054:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5605:x1874703862990720:12345-192.168.204.29@tcp:502: Request processed in 291us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857063.935062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:3.0:1787857063.938351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857063.941439:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990848 00000100:00100000:2.0:1787857063.941454:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990848 00000100:00100000:2.0:1787857063.941530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1787857063.941541:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5605:x1874703862990848:12345-192.168.204.29@tcp:502: 00000100:00100000:2.0:1787857063.942722:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5605:x1874703862990848:12345-192.168.204.29@tcp:502: Request processed in 1178us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857063.942733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1787857063.954045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857063.954425:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862990976 00000100:00100000:0.0:1787857063.954436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862990976 00000100:00100000:0.0:1787857063.954497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1787857063.954506:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1874703862990976:12345-192.168.204.29@tcp:38: 00010000:00080000:0.0:1787857063.954895:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787857063.954944:0:5838:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbe78d 00000004:00100000:0.0:1787857063.954977:0:5838:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787857063.954984:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787857063.995651:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857063.995764:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703862990976:12345-192.168.204.29@tcp:38: Request processed in 41257us (41727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857063.995776:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:1.0:1787857064.391993:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857064.777275:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885032832:0@lo:400: 00000100:00100000:2.0:1787857064.777356:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857064.777420:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857064.777426:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885032704:0@lo:400: 00000100:00100000:2.0:1787857064.777452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857064.777488:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032832 00000100:00100000:2.0:1787857064.777496:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032832 00000100:00100000:2.0:1787857064.777553:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787857064.777562:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885032832:12345-0@lo:400: 00000100:00100000:2.0:1787857064.777616:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885032832:12345-0@lo:400: Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857064.777623:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787857064.777644:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787857064.777714:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4bf480 x1874703885032832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857064.777729:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885032832:0@lo:400: 00000100:00100000:1.0:1787857064.777965:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885032448:0@lo:400: 00000100:00100000:1.0:1787857064.778003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857064.778039:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885032960:0@lo:400: 00000100:00100000:1.0:1787857064.778063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857064.778082:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787857064.778088:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885032576:0@lo:400: 00000100:00100000:1.0:1787857064.778109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857064.778144:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885033088:0@lo:400: 00000100:00100000:1.0:1787857064.778642:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857064.778707:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032704 00000100:00100000:1.0:1787857064.778713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032704 00000100:00100000:0.0:1787857064.778879:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033088 00000100:00100000:0.0:1787857064.778884:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033088 00000100:00100000:0.0:1787857064.778915:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857064.778923:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885033088:12345-0@lo:400: 00000100:00100000:0.0:1787857064.778967:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885033088:12345-0@lo:400: Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857064.778974:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857064.778992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032960 00000100:00100000:0.0:1787857064.778995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032960 00000100:00100000:0.0:1787857064.779015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032576 00000100:00100000:0.0:1787857064.779017:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032576 00000100:00100000:0.0:1787857064.779027:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787857064.779033:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885032960:12345-0@lo:400: 00000100:00100000:0.0:1787857064.779070:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885032960:12345-0@lo:400: Request processed in 37us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857064.779090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787857064.779101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857064.779107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885032576:12345-0@lo:400: 00000100:00100000:0.0:1787857064.779128:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885032576:12345-0@lo:400: Request processed in 21us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857064.779133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787857064.779580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787857064.779588:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885032704:12345-0@lo:400: 00000100:00100000:1.0:1787857064.779626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885032704:12345-0@lo:400: Request processed in 39us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857064.779631:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787857064.779646:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857064.779649:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787857064.779701:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71c000 x1874703885032576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857064.779714:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885032576:0@lo:400: 00010000:00080000:1.0:1787857064.779724:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4bcf00 x1874703885033088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857064.779830:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885032448 00000100:00100000:3.0:1787857064.779835:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885032448 00000100:00100000:1.0:1787857064.779881:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787857064.779896:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885033088:0@lo:400: 00010000:00080000:1.0:1787857064.779909:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4bd680 x1874703885032960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857064.779917:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885032960:0@lo:400: 00010000:00080000:1.0:1787857064.779951:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71d680 x1874703885032704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857064.779960:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885032704:0@lo:400: 00000100:00100000:3.0:1787857064.784083:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787857064.784112:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885032448:12345-0@lo:400: 00000100:00100000:1.0:1787857064.784168:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885033216:0@lo:13: 00000100:00100000:1.0:1787857064.784237:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857064.784314:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033216 00000100:00100000:2.0:1787857064.784321:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033216 00000100:00100000:2.0:1787857064.784379:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857064.784387:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885033216:12345-0@lo:13: 00002000:00000024:2.0:1787857064.784420:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857064.785843:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885032448:0@lo:400: 00000100:00100000:3.0:1787857064.793813:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885032448:12345-0@lo:400: Request processed in 9705us (15797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857064.793831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787857064.795009:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885033216:12345-0@lo:13: Request processed in 10616us (10765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857064.795039:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787857064.795286:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a404780 x1874703885033216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857064.795313:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885033216:0@lo:13: 00000100:00100000:2.0:1787857065.021516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857065.021753:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991232 00000100:00100000:1.0:1787857065.021762:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991232 00000100:00100000:1.0:1787857065.021863:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857065.021874:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991232:12345-192.168.204.29@tcp:41: 00000004:00000024:1.0:1787857065.021919:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1787857065.022041:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857065.027885:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991232:12345-192.168.204.29@tcp:41: Request processed in 6001us (6369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857065.027901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1787857065.032083:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857065.033919:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991104 00000100:00100000:3.0:1787857065.033936:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991104 00000100:00100000:3.0:1787857065.034017:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1787857065.034028:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:0:x1874703862991104:12345-192.168.204.29@tcp:41: 00000004:00000024:3.0:1787857065.034061:0:8075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787857065.034150:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:0:x1874703862991104:12345-192.168.204.29@tcp:41: Request processed in 124us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857065.034167:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1787857065.042883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857065.043029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991360 00000100:00100000:0.0:1787857065.043039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991360 00000100:00100000:0.0:1787857065.043109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1787857065.043120:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991360:12345-192.168.204.29@tcp:40: 00000100:00100000:0.0:1787857065.043269:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991360:12345-192.168.204.29@tcp:40: Request processed in 151us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857065.043278:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857065.053452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857065.053502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857065.053538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857065.053648:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991488 00000100:00100000:2.0:1787857065.053690:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991488 00000100:00100000:2.0:1787857065.053733:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991616 00000100:00100000:2.0:1787857065.053737:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991616 00000100:00100000:2.0:1787857065.053758:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1787857065.053765:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874703862991488:12345-192.168.204.29@tcp:8: 00010000:00080000:2.0:1787857065.053798:0:6676:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1787857065.053831:0:6676:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbe794 00002000:00100000:2.0:1787857065.053854:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1/ffff9fd9497f3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787857065.053879:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787857065.054351:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787857065.054389:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9fd9497f7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857065.054474:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703862991488:12345-192.168.204.29@tcp:8: Request processed in 708us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857065.054483:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1787857065.054508:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1787857065.054513:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874703862991616:12345-192.168.204.29@tcp:8: 00010000:00080000:2.0:1787857065.054531:0:6676:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:2.0:1787857065.054554:0:6676:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbe79b 00002000:00100000:2.0:1787857065.054561:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1/ffff9fd9497f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787857065.054568:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787857065.054853:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787857065.054870:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9fd9497f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857065.054895:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703862991616:12345-192.168.204.29@tcp:8: Request processed in 380us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857065.054902:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1787857065.055127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991744 00000100:00100000:0.0:1787857065.055133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991744 00000100:00100000:0.0:1787857065.055182:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1787857065.055190:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991744:12345-192.168.204.29@tcp:33: 00000100:00100000:0.0:1787857065.067465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857065.069608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862991872 00000100:00100000:2.0:1787857065.069627:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862991872 00000100:00100000:2.0:1787857065.069745:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 127 00000100:00100000:2.0:1787857065.069758:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862991872:12345-192.168.204.29@tcp:400: 00000100:00100000:2.0:1787857065.069879:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862991872:12345-192.168.204.29@tcp:400: Request processed in 123us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857065.069887:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 127 00000004:00080000:2.0:1787857065.091596:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36334us 00000004:00200000:1.0:1787857065.124911:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787857065.125105:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5580:x1874703862991744:12345-192.168.204.29@tcp:33: Request processed in 69910us (71659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857065.125127:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1787857065.409778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857065.409935:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992000 00000100:00100000:3.0:1787857065.409945:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992000 00000100:00100000:3.0:1787857065.410007:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1787857065.410017:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5623:x1874703862992000:12345-192.168.204.29@tcp:101: 00010000:00010000:3.0:1787857065.410054:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857065.410136:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d200/0xf326646fe3bbe7a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882761 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410224:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410238:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410252:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857065.410780:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787857065.410787:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857065.410884:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410914:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d200/0xf326646fe3bbe7a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882761 expref: 8 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410935:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882761 expref: 7 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857065.410942:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159d00) 00010000:00010000:3.0:1787857065.410945:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857065.410948:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216dc00, rc 0) 00000100:00100000:3.0:1787857065.411021:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:5623:x1874703862992000:12345-192.168.204.29@tcp:101: Request processed in 1006us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857065.411028:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:1.0:1787857065.415948:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857065.800079:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885033344:0@lo:13: 00000100:00100000:0.0:1787857065.800168:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857065.804380:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033344 00000100:00100000:3.0:1787857065.804396:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033344 00000100:00100000:3.0:1787857065.804481:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787857065.804492:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a6383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885033344:12345-0@lo:13: 00002000:00000024:3.0:1787857065.804521:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857065.804622:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a6383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885033344:12345-0@lo:13: Request processed in 132us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857065.804629:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787857065.804810:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b6940 x1874703885033344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857065.804842:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885033344:0@lo:13: 00010000:00010000:1.0:1787857066.439940:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857067.469890:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857067.786026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857067.786146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992128 00000100:00100000:0.0:1787857067.786156:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992128 00000100:00100000:0.0:1787857067.786251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1787857067.786263:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:5675:x1874703862992128:12345-192.168.204.29@tcp:41: 00000004:00000024:0.0:1787857067.786323:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787857067.786399:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:5675:x1874703862992128:12345-192.168.204.29@tcp:41: Request processed in 138us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857067.786407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00080000:3.0:1787857067.787839:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857067.790236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857067.790561:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992256 00000100:00100000:2.0:1787857067.790573:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992256 00000100:00100000:2.0:1787857067.791003:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1787857067.791017:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5675:x1874703862992256:12345-192.168.204.29@tcp:13: 00002000:00000024:2.0:1787857067.791058:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857067.791130:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5675:x1874703862992256:12345-192.168.204.29@tcp:13: Request processed in 117us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857067.791138:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00080000:3.0:1787857067.791356:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857067.796074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857067.796355:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992384 00000100:00100000:0.0:1787857067.796365:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992384 00000100:00100000:0.0:1787857067.796437:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857067.796449:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5675:x1874703862992384:12345-192.168.204.29@tcp:13: 00002000:00000024:0.0:1787857067.796488:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787857067.796761:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857067.796861:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:5675:x1874703862992384:12345-192.168.204.29@tcp:13: Request processed in 413us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857067.796870:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000001:00100000:0.0:1787857068.417886:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00010000:00010000:1.0:1787857068.488965:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787857069.466152:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00010000:00010000:1.0:1787857069.511915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857069.895950:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885033472:0@lo:400: 00000100:00100000:0.0:1787857069.896031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857069.896192:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033472 00000100:00100000:1.0:1787857069.896201:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033472 00000100:00100000:1.0:1787857069.896256:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787857069.896266:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885033472:12345-0@lo:400: 00000100:00100000:0.0:1787857069.898652:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885033984:0@lo:400: 00000100:00100000:0.0:1787857069.898724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857069.899429:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885033472:12345-0@lo:400: Request processed in 3160us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857069.899442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787857069.899539:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885033600:0@lo:13: 00000100:00100000:1.0:1787857069.899572:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857069.899606:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885033856:0@lo:400: 00000100:00100000:1.0:1787857069.899629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857069.899647:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857069.899652:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885033728:0@lo:400: 00000100:00100000:1.0:1787857069.899686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857069.899733:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033600 00000100:00100000:1.0:1787857069.899741:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033600 00000100:00100000:1.0:1787857069.899802:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857069.899810:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885033600:12345-0@lo:13: 00002000:00000024:1.0:1787857069.899857:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857069.899905:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885033600:12345-0@lo:13: Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857069.899911:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857069.899931:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033856 00000100:00100000:1.0:1787857069.899935:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033856 00000100:00100000:1.0:1787857069.899977:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033728 00000100:00100000:1.0:1787857069.899979:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033728 00000100:00100000:1.0:1787857069.899995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787857069.900000:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885033856:12345-0@lo:400: 00000100:00100000:1.0:1787857069.900032:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885033856:12345-0@lo:400: Request processed in 32us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857069.900038:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787857069.900047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857069.900052:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885033728:12345-0@lo:400: 00000100:00100000:1.0:1787857069.900087:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885033728:12345-0@lo:400: Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857069.900093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787857069.900109:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857069.900113:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787857069.900544:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4043c0 x1874703885033600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857069.900566:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885033600:0@lo:13: 00000100:00100000:1.0:1787857069.900593:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885033728:0@lo:400: 00000100:00100000:1.0:1787857069.900601:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885033856:0@lo:400: 00000100:00100000:2.0:1787857069.903006:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885033984 00000100:00100000:2.0:1787857069.903018:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885033984 00000100:00100000:2.0:1787857069.903099:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857069.903111:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885033984:12345-0@lo:400: 00000100:00100000:2.0:1787857069.903352:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885033984:12345-0@lo:400: Request processed in 244us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857069.903361:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787857069.904228:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885033472:0@lo:400: 00010000:00080000:0.0:1787857069.906037:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4bf480 x1874703885033984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857069.906491:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885033984:0@lo:400: 00000100:00080000:0.0:1787857069.906557:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857069.909352:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857069.909377:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885034112:0@lo:400: 00000100:00100000:0.0:1787857069.909447:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857069.909544:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885034112 00000100:00100000:3.0:1787857069.909552:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885034112 00000100:00100000:3.0:1787857069.909610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787857069.909620:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885034112:12345-0@lo:400: 00000100:00100000:3.0:1787857069.909699:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885034112:12345-0@lo:400: Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857069.909707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787857069.909764:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885034112:0@lo:400: 00000100:00080000:0.0:1787857069.909935:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787857069.957231:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000100:00100000:3.0:1787857070.433332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857070.433410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992512 00000100:00100000:0.0:1787857070.433420:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992512 00000100:00100000:0.0:1787857070.433488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:0.0:1787857070.433499:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862992512:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1787857070.433577:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862992512:12345-192.168.204.29@tcp:400: Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857070.433584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:3.0:1787857070.438251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857070.438289:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992640 00000100:00100000:3.0:1787857070.438290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857070.438298:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992640 00000100:00100000:3.0:1787857070.438321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857070.438342:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992896 00000100:00100000:3.0:1787857070.438345:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992896 00000100:00100000:2.0:1787857070.438360:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:2.0:1787857070.438369:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862992640:12345-192.168.204.29@tcp:400: 00000100:00100000:3.0:1787857070.438370:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862992768 00000100:00100000:3.0:1787857070.438372:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862992768 00000100:00100000:3.0:1787857070.438400:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1787857070.438405:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862992896:12345-192.168.204.29@tcp:400: 00000100:00100000:0.0:1787857070.438475:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1787857070.438484:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862992768:12345-192.168.204.29@tcp:400: 00000100:00100000:2.0:1787857070.439091:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862992640:12345-192.168.204.29@tcp:400: Request processed in 721us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857070.439099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1787857070.439265:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862992896:12345-192.168.204.29@tcp:400: Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857070.439274:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00080000:1.0:1787857070.440816:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857070.440825:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857070.440828:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857070.441735:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862992768:12345-192.168.204.29@tcp:400: Request processed in 3243us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857070.441759:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00010000:00010000:2.0:1787857070.536148:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857070.561250:0:8284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787857070.920021:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857070.920048:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885034240:0@lo:13: 00000100:00100000:3.0:1787857070.920133:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857070.920506:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885034240 00000100:00100000:0.0:1787857070.920515:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885034240 00000100:00100000:0.0:1787857070.920569:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787857070.920578:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885034240:12345-0@lo:13: 00002000:00000024:0.0:1787857070.920613:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857070.920693:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885034240:12345-0@lo:13: Request processed in 116us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857070.920700:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787857070.920793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd952a95e00 x1874703885034240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857070.920811:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885034240:0@lo:13: 00010000:00010000:1.0:1787857071.559949:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857072.584192:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857073.610199:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787857074.123997:0:8431:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc90044400 20000000:00000080:3.0:1787857074.124017:0:8431:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd97fdfdc00 uarg=0000000000000000 20000000:01000000:3.0:1787857074.124124:0:8431:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787857074.124127:0:8431:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787857074.124129:0:8431:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787857074.124134:0:8431:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787857074.124138:0:8431:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787857074.124151:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787857074.124153:0:8431:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787857074.124332:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787857074.124335:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787857074.130043:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787857074.130758:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787857074.130815:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787857074.130864:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787857074.130878:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787857074.130881:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787857074.134255:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787857074.139853:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787857074.139946:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787857074.139984:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787857074.140004:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787857074.140006:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787857074.145874:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787857074.146505:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787857074.146577:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787857074.146616:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787857074.146628:0:8431:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787857074.146630:0:8431:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787857074.150259:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787857074.157491:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787857074.157759:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787857074.158536:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1787857074.158571:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787857074.158596:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158614:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158621:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158628:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158635:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158641:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158647:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158653:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158697:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158706:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158727:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158764:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.158781:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 9 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.158795:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034368:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857074.159488:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.159499:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 9 pid: 5829 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.159509:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034496:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857074.159544:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.159552:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.159560:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034624:0@lo:104: 00000100:00100000:0.0:1787857074.159599:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857074.159650:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.159699:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.159708:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034752:0@lo:104: 00000100:00100000:0.0:1787857074.159737:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857074.159773:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787857074.159778:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.159786:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 18 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.159787:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885034624 00000100:00100000:1.0:1787857074.159794:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885034624 00000100:00100000:0.0:1787857074.159794:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034880:0@lo:104: 00000100:00100000:2.0:1787857074.159795:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885034752 00000100:00100000:2.0:1787857074.159802:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885034752 00000100:00100000:0.0:1787857074.159818:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857074.159835:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885034880 00000100:00100000:1.0:1787857074.159840:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787857074.159841:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885034880 00000100:00100000:1.0:1787857074.159854:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:8431:x1874703885034624:12345-0@lo:104: 00010000:00010000:1.0:1787857074.159867:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.160164:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.160490:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 18 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.160502:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035008:0@lo:104: 00010000:00010000:1.0:1787857074.164216:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857074.164234:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:8431:x1874703885034624:12345-0@lo:104: Request processed in 4379us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.164247:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787857074.164248:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857074.164258:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164270:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489a00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.164274:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164285:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.164309:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.164315:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.164360:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164366:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.164385:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164392:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489a00/0xf326646fe3bbe755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164406:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.164408:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.164410:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857074.164432:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885035136:0@lo:103: 00000100:00100000:2.0:1787857074.164475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857074.164525:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035136 00000100:00100000:2.0:1787857074.164531:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035136 00010000:00010000:2.0:1787857074.164559:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857074.164585:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787857074.164593:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885035136:12345-0@lo:103: 00010000:00010000:2.0:1787857074.164606:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857074.164611:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164628:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.164647:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857074.164779:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885035136:12345-0@lo:103: Request processed in 186us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857074.164786:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787857074.164820:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885035136:0@lo:103: 00000100:00100000:1.0:1787857074.164843:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857074.164855:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885034752:12345-0@lo:104: 00010000:00010000:1.0:1787857074.164866:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.165023:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857074.165030:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885034752:12345-0@lo:104: Request processed in 178us (5291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.165036:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857074.165094:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857074.165102:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8431:x1874703885034880:12345-0@lo:104: 00010000:00010000:1.0:1787857074.165111:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.165144:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787857074.165149:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8431:x1874703885034880:12345-0@lo:104: Request processed in 50us (5332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.165155:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787857074.165790:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857074.165799:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165809:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341b000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.165813:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165822:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.165829:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.165835:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.165879:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165886:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.165903:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165922:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe739 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165934:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857074.165937:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165943:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.165946:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165953:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.165959:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.165964:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.165977:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165983:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.165988:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.165995:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd982045200/0xf326646fe3bbe716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe71d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.166004:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.166011:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.166013:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857074.166029:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885035392:0@lo:103: 00000100:00100000:2.0:1787857074.166218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857074.166266:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857074.166272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885035264:0@lo:103: 00000100:00100000:2.0:1787857074.166308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787857074.166335:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857074.166345:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035392 00000100:00100000:2.0:1787857074.166350:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035392 00010000:00010000:2.0:1787857074.166374:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857074.166395:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035264 00000100:00100000:2.0:1787857074.166398:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035264 00010000:00010000:2.0:1787857074.166413:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 20 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857074.166426:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787857074.166432:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3312:x1874703885035392:12345-0@lo:103: 00010000:00010000:2.0:1787857074.166443:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857074.166448:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 20 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.166458:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 20 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.166475:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857074.166505:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3312:x1874703885035392:12345-0@lo:103: Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857074.166520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787857074.166534:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787857074.166540:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885035264:12345-0@lo:103: 00010000:00010000:2.0:1787857074.166547:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857074.166551:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.166560:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.166570:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857074.166594:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885035264:12345-0@lo:103: Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857074.166600:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787857074.166632:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885035264:0@lo:103: 00000100:00100000:2.0:1787857074.166641:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a407c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885035392:0@lo:103: 00000100:00100000:2.0:1787857074.170344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857074.170526:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993152 00000100:00100000:3.0:1787857074.170547:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993152 00010000:00010000:3.0:1787857074.170714:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 10 pid: 5829 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.170866:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1787857074.170878:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862993152:12345-192.168.204.29@tcp:103: 00010000:00010000:3.0:1787857074.170894:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857074.170901:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 10 pid: 5829 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.170914:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 10 pid: 5829 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.171013:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857074.171071:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862993152:12345-192.168.204.29@tcp:103: Request processed in 195us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857074.171407:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1787857074.171412:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857074.172316:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993024 00000100:00100000:3.0:1787857074.172325:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993024 00010000:00010000:3.0:1787857074.172355:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 10 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.174239:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1787857074.174262:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862993024:12345-192.168.204.29@tcp:103: 00010000:00010000:1.0:1787857074.174281:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857074.174291:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 10 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.174307:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 10 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.174331:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857074.174382:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862993024:12345-192.168.204.29@tcp:103: Request processed in 131us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.174390:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857074.174407:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857074.175749:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.175766:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.175780:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035520:0@lo:104: 00000100:00100000:0.0:1787857074.175864:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857074.175901:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.175911:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 18 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.175916:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035008 00000100:00100000:1.0:1787857074.175925:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035008 00000100:00100000:1.0:1787857074.175959:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035520 00000100:00100000:1.0:1787857074.175962:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035520 00000100:00100000:1.0:1787857074.175974:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857074.175983:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035008:12345-0@lo:104: 00010000:00010000:1.0:1787857074.176006:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.176041:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035648:0@lo:104: 00000100:00100000:0.0:1787857074.176071:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857074.176076:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857074.176084:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035008:12345-0@lo:104: Request processed in 101us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.176094:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787857074.176094:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.176107:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 18 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.176114:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035648 00000100:00100000:0.0:1787857074.176117:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035776:0@lo:104: 00000100:00100000:1.0:1787857074.176120:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035648 00000100:00100000:1.0:1787857074.176143:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787857074.176148:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857074.176155:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035520:12345-0@lo:104: 00000100:00100000:0.0:1787857074.176163:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd840 going to sleep for 11 seconds 00010000:00010000:1.0:1787857074.176164:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.176210:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787857074.176211:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882706 expref: 9 pid: 5830 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.176219:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035520:12345-0@lo:104: Request processed in 66us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.176229:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857074.176245:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035776 00000100:00100000:1.0:1787857074.176249:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035776 00000100:00100000:1.0:1787857074.176262:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857074.176267:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035648:12345-0@lo:104: 00010000:00010000:1.0:1787857074.176275:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.176315:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787857074.176320:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8431:x1874703885035648:12345-0@lo:104: Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.176334:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857074.176346:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787857074.176352:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8431:x1874703885035776:12345-0@lo:104: 00010000:00010000:1.0:1787857074.176359:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.176382:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034368:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857074.176388:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787857074.176394:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8431:x1874703885035776:12345-0@lo:104: Request processed in 42us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.176399:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787857074.176405:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953489600/0xf326646fe3bbe771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8826ff expref: 8 pid: 5829 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176539:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787857074.176547:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.176556:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787857074.176556:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.176561:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176571:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.176587:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.176592:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.176632:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176639:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.176683:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176691:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd982044600/0xf326646fe3bbe708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe70f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176705:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857074.176708:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176714:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.176716:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176722:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.176728:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.176733:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.176754:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176761:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.176768:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176775:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341a800/0xf326646fe3bbe6d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6d7 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176784:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857074.176787:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176792:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.176795:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176802:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.176808:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.176812:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.176845:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176852:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857074.176873:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.176890:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd98216d600/0xf326646fe3bbe6a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6ad expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.176900:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885036160:0@lo:103: 00010000:00010000:2.0:1787857074.176901:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.176904:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.176907:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857074.176938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857074.176983:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036160 00000100:00100000:3.0:1787857074.176987:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036160 00010000:00010000:3.0:1787857074.177009:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.177041:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787857074.177049:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885036160:12345-0@lo:103: 00010000:00010000:3.0:1787857074.177061:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857074.177067:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.177073:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034496:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857074.177080:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.177096:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe75c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe755 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.177099:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857074.177120:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034624:0@lo:104: 00000100:00100000:3.0:1787857074.177134:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3311:x1874703885036160:12345-0@lo:103: Request processed in 85us (194us total) trans 0 rc 0/0 00010000:00010000:0.0:1787857074.177140:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982045400/0xf326646fe3bbe739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe732 expref: 18 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.177145:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787857074.177156:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034752:0@lo:104: 00000100:00100000:3.0:1787857074.177178:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885036160:0@lo:103: 00010000:00010000:0.0:1787857074.177183:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216de00/0xf326646fe3bbe71d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe716 expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857074.177195:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885034880:0@lo:104: 00000100:00100000:0.0:1787857074.177208:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035008:0@lo:104: 00000100:00100000:0.0:1787857074.177215:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035520:0@lo:104: 00000100:00100000:0.0:1787857074.177222:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035648:0@lo:104: 00010000:00010000:0.0:1787857074.177228:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe6ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe6a6 expref: 15 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857074.177327:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885035904:0@lo:103: 00000100:00100000:2.0:1787857074.177364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857074.177393:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857074.177399:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885036032:0@lo:103: 00000100:00100000:3.0:1787857074.177432:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885035904 00000100:00100000:3.0:1787857074.177436:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885035904 00000100:00100000:2.0:1787857074.177495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857074.177531:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036032 00000100:00100000:1.0:1787857074.177538:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036032 00010000:00010000:1.0:1787857074.177553:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 17 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857074.177583:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787857074.177590:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3309:x1874703885036032:12345-0@lo:103: 00010000:00010000:1.0:1787857074.177598:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857074.177602:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 17 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.177610:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 17 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.177621:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982045600/0xf326646fe3bbe6d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe6d0 expref: 17 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857074.177630:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857074.177707:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ae580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3309:x1874703885036032:12345-0@lo:103: Request processed in 117us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857074.177714:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857074.177766:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8431:1874703885035776:0@lo:104: 00010000:00010000:0.0:1787857074.177806:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857074.177844:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885036032:0@lo:103: 00010000:00010000:3.0:1787857074.177938:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.177995:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787857074.178003:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3309:x1874703885035904:12345-0@lo:103: 00010000:00010000:3.0:1787857074.178012:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857074.178016:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 14 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.178026:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 14 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.178049:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d400/0xf326646fe3bbe70f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe708 expref: 14 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.178058:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857074.178095:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3309:x1874703885035904:12345-0@lo:103: Request processed in 95us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857074.178102:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787857074.178168:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885035904:0@lo:103: 00010000:00010000:3.0:1787857074.178359:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857074.178362:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857074.178364:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.178381:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.178390:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857074.178394:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.178403:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857074.178410:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857074.178415:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787857074.178538:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.178546:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787857074.178589:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787857074.178608:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.178616:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341a000/0xf326646fe3bbe6fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe701 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.178633:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.178635:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857074.178637:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857074.180835:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885036288:0@lo:103: 00000100:00100000:1.0:1787857074.180910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857074.181127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036288 00000100:00100000:3.0:1787857074.181135:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036288 00010000:00010000:3.0:1787857074.181170:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 13 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857074.181204:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787857074.181212:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:3311:x1874703885036288:12345-0@lo:103: 00010000:00010000:3.0:1787857074.181225:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857074.181230:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 13 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181242:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 13 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181260:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982045e00/0xf326646fe3bbe701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe6fa expref: 13 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181276:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181303:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181318:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181325:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181333:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181340:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181346:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857074.181350:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181358:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181373:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857074.181382:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857074.181417:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3311:x1874703885036288:12345-0@lo:103: Request processed in 206us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857074.181423:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787857074.181492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885036288:0@lo:103: 00010000:00010000:0.0:1787857074.190160:0:8431:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.190193:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857074.190200:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975561e00/0xf326646fe3bbe7b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857074.631867:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857075.016409:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857075.016447:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885036416:0@lo:13: 00000100:00100000:1.0:1787857075.016522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857075.016895:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036416 00000100:00100000:2.0:1787857075.016904:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036416 00000100:00100000:2.0:1787857075.016971:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787857075.016981:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885036416:12345-0@lo:13: 00002000:00000024:2.0:1787857075.017016:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857075.017066:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885036416:12345-0@lo:13: Request processed in 87us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857075.017073:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787857075.017279:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787857075.017309:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8acf00 x1874703885036416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857075.017328:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885036416:0@lo:13: 00000100:00100000:1.0:1787857075.018196:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885036672:0@lo:400: 00000100:00100000:1.0:1787857075.018245:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857075.018278:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857075.018283:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885036800:0@lo:400: 00000100:00100000:1.0:1787857075.018304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857075.018330:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036672 00000100:00100000:1.0:1787857075.018335:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036672 00000100:00100000:1.0:1787857075.018363:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036800 00000100:00100000:1.0:1787857075.018365:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036800 00000100:00100000:1.0:1787857075.018389:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787857075.018396:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885036672:12345-0@lo:400: 00000100:00100000:1.0:1787857075.018445:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885036672:12345-0@lo:400: Request processed in 38us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857075.018469:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787857075.018483:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787857075.018488:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885036800:12345-0@lo:400: 00000100:00100000:1.0:1787857075.018513:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885036800:12345-0@lo:400: Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857075.018517:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787857075.018530:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857075.018554:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885036800:0@lo:400: 00000100:00100000:1.0:1787857075.018564:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885036672:0@lo:400: 00000100:00100000:1.0:1787857075.018588:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885036544:0@lo:400: 00000100:00100000:1.0:1787857075.018617:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857075.018641:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd951550b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885037056:0@lo:400: 00000100:00100000:1.0:1787857075.018710:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857075.018726:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857075.018990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037056 00000100:00100000:3.0:1787857075.019001:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037056 00000100:00100000:3.0:1787857075.019033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857075.019039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885037056:12345-0@lo:400: 00000100:00100000:3.0:1787857075.019073:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885037056:12345-0@lo:400: Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857075.019080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787857075.019094:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857075.019120:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036544 00000100:00100000:3.0:1787857075.019124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036544 00000100:00100000:3.0:1787857075.019148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787857075.019154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3310:x1874703885036544:12345-0@lo:400: 00000100:00100000:3.0:1787857075.019184:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:3310:x1874703885036544:12345-0@lo:400: Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857075.019189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787857075.020830:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885036928:0@lo:400: 00000100:00100000:1.0:1787857075.021030:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857075.021099:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885036544:0@lo:400: 00000100:00100000:1.0:1787857075.021118:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd951550b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885037056:0@lo:400: 00000100:00100000:2.0:1787857075.021404:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885036928 00000100:00100000:2.0:1787857075.021411:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885036928 00000100:00100000:2.0:1787857075.021492:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787857075.021502:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885036928:12345-0@lo:400: 00000100:00100000:2.0:1787857075.021566:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885036928:12345-0@lo:400: Request processed in 66us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857075.021573:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787857075.022035:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787857075.022507:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd952a95e00 x1874703885036928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857075.022520:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885036928:0@lo:400: 00000100:00100000:3.0:1787857075.552762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857075.552809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857075.552847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857075.552873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857075.552903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993408 00000100:00100000:1.0:1787857075.552912:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993280 00000100:00100000:3.0:1787857075.552913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993408 00000100:00100000:1.0:1787857075.552920:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993280 00000100:00100000:3.0:1787857075.552999:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1787857075.552999:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:3.0:1787857075.553017:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703862993408:12345-192.168.204.29@tcp:400: 00000100:00100000:1.0:1787857075.553191:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:2355:x1874703862993280:12345-192.168.204.29@tcp:400: 00000100:00100000:1.0:1787857075.553262:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:2355:x1874703862993280:12345-192.168.204.29@tcp:400: Request processed in 251us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857075.553270:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00080000:1.0:1787857075.553344:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857075.553366:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993536 00000100:00100000:2.0:1787857075.553379:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993536 00000100:00100000:2.0:1787857075.553420:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993664 00000100:00100000:2.0:1787857075.553424:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993664 00000100:00080000:1.0:1787857075.553461:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857075.553465:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857075.553524:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703862993408:12345-192.168.204.29@tcp:400: Request processed in 512us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857075.553531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1787857075.560010:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857075.560036:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862993536:12345-192.168.204.29@tcp:400: 00000100:00100000:2.0:1787857075.560138:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862993536:12345-192.168.204.29@tcp:400: Request processed in 115us (7328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857075.560157:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857075.560178:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1787857075.560186:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703862993664:12345-192.168.204.29@tcp:400: 00000100:00100000:2.0:1787857075.560212:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703862993664:12345-192.168.204.29@tcp:400: Request processed in 27us (7339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857075.560219:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:3.0:1787857075.655974:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787857076.039948:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787857076.039973:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd975d01000 from 39 10000000:01000000:3.0:1787857076.039979:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787857076.040022:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.040033:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.040044:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857076.040080:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037184:0@lo:101: 00000100:00100000:3.0:1787857076.040274:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857076.040542:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868240 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.040700:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885037312:0@lo:13: 00000100:00100000:2.0:1787857076.040746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857076.040992:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037312 00000100:00100000:3.0:1787857076.040999:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037312 00000100:00100000:3.0:1787857076.041060:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787857076.041069:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885037312:12345-0@lo:13: 00002000:00000024:3.0:1787857076.041105:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857076.042860:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037184 00000100:00100000:0.0:1787857076.042874:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037184 00000100:00100000:0.0:1787857076.042933:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787857076.042942:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+12:5833:x1874703885037184:12345-0@lo:101: 00010000:00010000:0.0:1787857076.042956:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857076.042976:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975561200/0xf326646fe3bbe7be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7b7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.043004:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975561200/0xf326646fe3bbe7be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7b7 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.043013:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975561200/0xf326646fe3bbe7be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7b7 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.043022:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561200, rc 0) 00000100:00100000:0.0:1787857076.043093:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037184:12345-0@lo:101: Request processed in 153us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.043100:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787857076.045277:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037184:0@lo:101: 00010000:00010000:1.0:1787857076.045316:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.045328:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.045428:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037440:0@lo:501: 00000100:00100000:1.0:1787857076.045485:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.045529:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.045548:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037440 00000100:00100000:1.0:1787857076.045554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037440 00000100:00100000:1.0:1787857076.045607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787857076.045615:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037440:12345-0@lo:501: 00000100:00100000:1.0:1787857076.046239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037440:12345-0@lo:501: Request processed in 623us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.046247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787857076.046984:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037440:0@lo:501: 00000100:00100000:1.0:1787857076.047022:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037568:0@lo:503: 00000100:00100000:1.0:1787857076.047072:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.047091:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.047109:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037568 00000100:00100000:1.0:1787857076.047113:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037568 00000100:00100000:1.0:1787857076.047690:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787857076.047701:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037568:12345-0@lo:503: 00000100:00100000:1.0:1787857076.047930:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037568:12345-0@lo:503: Request processed in 231us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.047937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787857076.047984:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037568:0@lo:503: 00000100:00100000:1.0:1787857076.051426:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8452:1874703885037696:0@lo:502: 00000100:00100000:1.0:1787857076.051519:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.051574:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.051875:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037696 00000100:00100000:0.0:1787857076.051883:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037696 00000100:00100000:0.0:1787857076.051930:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787857076.051938:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:8452:x1874703885037696:12345-0@lo:502: 00000100:00100000:0.0:1787857076.052466:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:8452:x1874703885037696:12345-0@lo:502: Request processed in 527us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.052474:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787857076.053265:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8452:1874703885037696:0@lo:502: 00000100:00100000:1.0:1787857076.053518:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8452:1874703885037824:0@lo:502: 00000100:00100000:1.0:1787857076.053571:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.053619:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857076.053734:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885037312:12345-0@lo:13: Request processed in 12663us (12985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857076.053744:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857076.056611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037824 00000100:00100000:0.0:1787857076.056636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037824 00000100:00100000:0.0:1787857076.056757:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787857076.056767:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:8452:x1874703885037824:12345-0@lo:502: 00000100:00100000:0.0:1787857076.059117:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:8452:x1874703885037824:12345-0@lo:502: Request processed in 2343us (5537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.059131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:2.0:1787857076.064074:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd952a95e00 x1874703885037312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857076.064107:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885037312:0@lo:13: 00000100:00100000:3.0:1787857076.068539:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8452:1874703885037824:0@lo:502: 00000040:00080000:3.0:1787857076.068791:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787857076.076171:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787857076.076210:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787857076.076224:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.076236:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857076.076247:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787857076.076271:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787857076.076274:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787857076.076324:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.076334:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.076344:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.076550:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037952:0@lo:101: 00000100:00100000:1.0:1787857076.076619:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.076703:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.077748:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885037952 00000100:00100000:2.0:1787857076.077757:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885037952 00000100:00100000:2.0:1787857076.077818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787857076.077828:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+13:5833:x1874703885037952:12345-0@lo:101: 00010000:00010000:2.0:1787857076.077844:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857076.077858:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a000/0xf326646fe3bbe7cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7c5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.077905:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a000/0xf326646fe3bbe7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7c5 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.077916:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a000/0xf326646fe3bbe7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7c5 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.077926:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a000, rc 0) 00000100:00100000:2.0:1787857076.077997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885037952:12345-0@lo:101: Request processed in 170us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.078004:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787857076.078203:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885037952:0@lo:101: 00010000:00010000:3.0:1787857076.078219:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.078228:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857076.078304:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038080:0@lo:501: 00000100:00100000:3.0:1787857076.078338:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857076.078371:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.078500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038080 00000100:00100000:0.0:1787857076.078506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038080 00000100:00100000:0.0:1787857076.078536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787857076.078542:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885038080:12345-0@lo:501: 00000100:00100000:0.0:1787857076.078973:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885038080:12345-0@lo:501: Request processed in 429us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.078980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787857076.079226:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038080:0@lo:501: 00000100:00100000:3.0:1787857076.079260:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038208:0@lo:503: 00000100:00100000:3.0:1787857076.079313:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857076.079333:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.079805:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038208 00000100:00100000:0.0:1787857076.079811:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038208 00000100:00100000:0.0:1787857076.079890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787857076.079898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885038208:12345-0@lo:503: 00000100:00100000:0.0:1787857076.080075:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885038208:12345-0@lo:503: Request processed in 177us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.080082:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787857076.080180:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038208:0@lo:503: 00000100:00100000:2.0:1787857076.088010:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8453:1874703885038336:0@lo:502: 00000100:00100000:2.0:1787857076.088112:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.088166:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97fa45780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.088293:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038336 00000100:00100000:1.0:1787857076.088302:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038336 00000100:00100000:1.0:1787857076.088360:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787857076.088370:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8453:x1874703885038336:12345-0@lo:502: 00000100:00100000:1.0:1787857076.088609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8453:x1874703885038336:12345-0@lo:502: Request processed in 239us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.088616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787857076.090625:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8453:1874703885038336:0@lo:502: 00000020:01000000:2.0:1787857076.090728:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857076.090740:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857076.090742:0:8453:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787857076.090749:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787857076.090784:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8453:1874703885038464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.090852:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.090887:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97fa45780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.091303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038464 00000100:00100000:1.0:1787857076.091310:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038464 00000100:00100000:1.0:1787857076.091360:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787857076.091368:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8453:x1874703885038464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.091588:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:8453:x1874703885038464:12345-0@lo:502:llog_process_th.0 Request processed in 219us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.091596:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787857076.091858:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8453:1874703885038464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787857076.091881:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857076.091887:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857076.091889:0:8453:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787857076.091893:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787857076.092078:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787857076.092103:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787857076.092115:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.092127:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857076.092136:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787857076.092139:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd950737800 from 39 10000000:01000000:1.0:1787857076.092142:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857076.092168:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.092175:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.092184:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.092200:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.092233:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.092268:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.092406:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038592 00000100:00100000:2.0:1787857076.092412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038592 00000100:00100000:2.0:1787857076.092441:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787857076.092449:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:5833:x1874703885038592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857076.092459:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857076.092471:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a800/0xf326646fe3bbe7da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7d3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.092491:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a800/0xf326646fe3bbe7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7d3 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.092501:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a800/0xf326646fe3bbe7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7d3 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.092509:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a800, rc 0) 00000100:00100000:2.0:1787857076.092543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885038592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.092549:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787857076.092613:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857076.092626:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.092646:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.092860:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.092894:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.092916:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.092959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038720 00000100:00100000:2.0:1787857076.092963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038720 00000100:00100000:2.0:1787857076.092992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787857076.092999:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885038720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857076.093229:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885038720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.093237:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787857076.093421:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.093450:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.093488:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.093518:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.094676:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038848 00000100:00100000:2.0:1787857076.094691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038848 00000100:00100000:2.0:1787857076.094753:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787857076.094763:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885038848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857076.094988:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885038848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.094997:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787857076.095943:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885038848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.098346:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8454:1874703885038976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.098429:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.098478:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.098596:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885038976 00000100:00100000:2.0:1787857076.098604:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885038976 00000100:00100000:2.0:1787857076.098677:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787857076.098688:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8454:x1874703885038976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.098980:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8454:x1874703885038976:12345-0@lo:502:llog_process_th.0 Request processed in 293us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.098988:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787857076.099214:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8454:1874703885038976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.099264:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8454:1874703885039104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.099316:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.099349:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945615d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.101183:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039104 00000100:00100000:2.0:1787857076.101198:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039104 00000100:00100000:2.0:1787857076.101271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787857076.101289:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8454:x1874703885039104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.101586:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:8454:x1874703885039104:12345-0@lo:502:llog_process_th.0 Request processed in 306us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.101594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787857076.102779:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8454:1874703885039104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857076.102825:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787857076.104702:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787857076.104743:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787857076.104755:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.104768:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857076.104777:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787857076.104780:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787857076.104798:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787857076.104834:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.104843:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.104854:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857076.104879:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857076.104944:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.104991:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.105070:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039232 00000100:00100000:0.0:1787857076.105077:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039232 00000100:00100000:0.0:1787857076.105125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787857076.105134:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:5833:x1874703885039232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857076.105147:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857076.105161:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975561600/0xf326646fe3bbe7e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.105185:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975561600/0xf326646fe3bbe7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7e1 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.105195:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975561600/0xf326646fe3bbe7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7e1 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.105203:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561600, rc 0) 00000100:00100000:0.0:1787857076.105271:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.105277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787857076.105611:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ad2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857076.105636:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.105645:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.105745:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.105776:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.105807:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.105930:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039360 00000100:00100000:2.0:1787857076.105935:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039360 00000100:00100000:2.0:1787857076.105962:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787857076.105969:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857076.106211:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.106218:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787857076.106686:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.106734:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.106778:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.106806:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.106828:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039488 00000100:00100000:1.0:1787857076.106832:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039488 00000100:00100000:1.0:1787857076.106859:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787857076.106866:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.107012:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.107018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787857076.107083:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.109212:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8455:1874703885039616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.110417:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.110465:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.110553:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039616 00000100:00100000:0.0:1787857076.110560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039616 00000100:00100000:0.0:1787857076.110601:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787857076.110611:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8455:x1874703885039616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.110912:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8455:x1874703885039616:12345-0@lo:502:llog_process_th.0 Request processed in 300us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.110920:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787857076.111115:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a95e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8455:1874703885039616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787857076.111149:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857076.111159:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857076.111161:0:8455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787857076.111167:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787857076.111196:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8455:1874703885039744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.111239:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.111269:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e6ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.111853:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039744 00000100:00100000:1.0:1787857076.111861:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039744 00000100:00100000:1.0:1787857076.111902:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787857076.111911:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8455:x1874703885039744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.112086:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:8455:x1874703885039744:12345-0@lo:502:llog_process_th.0 Request processed in 175us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.112093:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787857076.112620:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8455:1874703885039744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857076.112678:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857076.112685:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857076.112687:0:8455:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787857076.112691:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787857076.113855:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787857076.113879:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787857076.113890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.113902:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857076.113913:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787857076.113929:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96116a000 from 39 10000000:01000000:1.0:1787857076.113932:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787857076.113967:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.113975:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.113984:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.114005:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.114062:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.114108:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.114855:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885039872 00000100:00100000:2.0:1787857076.114864:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885039872 00000100:00100000:2.0:1787857076.114922:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787857076.114932:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885039872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857076.114943:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857076.114959:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7ef expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.114983:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7ef expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.114993:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7ef expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.115000:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341bc00, rc 0) 00000100:00100000:2.0:1787857076.115055:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885039872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.115062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787857076.115533:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885039872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857076.115550:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.115559:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.115619:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.116838:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.116888:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.116978:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040000 00000100:00100000:0.0:1787857076.116985:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040000 00000100:00100000:0.0:1787857076.117026:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787857076.117034:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885040000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.117395:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885040000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.117403:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787857076.117538:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.117579:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.117620:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.117654:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857076.117753:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040128 00000100:00100000:3.0:1787857076.117758:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040128 00000100:00100000:3.0:1787857076.117787:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787857076.117794:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885040128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857076.117934:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885040128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857076.117940:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787857076.119355:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857076.122038:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8456:1874703885040256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.122241:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.122280:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b868300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.122529:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040256 00000100:00100000:1.0:1787857076.122537:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040256 00000100:00100000:1.0:1787857076.122590:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787857076.122599:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8456:x1874703885040256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.123789:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8456:x1874703885040256:12345-0@lo:502:llog_process_th.0 Request processed in 1185us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.123802:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787857076.123972:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8456:1874703885040256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.124035:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8456:1874703885040384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857076.124090:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857076.124126:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e6e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857076.124232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040384 00000100:00100000:0.0:1787857076.124238:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040384 00000100:00100000:0.0:1787857076.124281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787857076.124289:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8456:x1874703885040384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.124474:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8456:x1874703885040384:12345-0@lo:502:llog_process_th.0 Request processed in 185us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.124481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787857076.125773:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8456:1874703885040384:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787857076.125817:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787857076.125986:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787857076.126004:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857076.126014:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.126025:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857076.126035:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787857076.126038:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787857076.126041:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857076.126083:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.126091:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.126099:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857076.126127:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.126177:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.126217:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.127499:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040512 00000100:00100000:2.0:1787857076.127522:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040512 00000100:00100000:2.0:1787857076.127563:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787857076.127571:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885040512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857076.127585:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857076.127602:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe7fd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.127640:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe7fd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.127650:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe7fd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.127675:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a200, rc 0) 00000100:00100000:2.0:1787857076.127743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885040512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.127750:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787857076.128431:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857076.128452:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.128463:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857076.128694:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.128745:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.128776:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.129100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040640 00000100:00100000:2.0:1787857076.129106:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040640 00000100:00100000:2.0:1787857076.129136:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787857076.129144:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885040640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857076.129429:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885040640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.129437:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787857076.129545:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.129578:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.129620:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.129657:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.129729:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040768 00000100:00100000:1.0:1787857076.129734:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040768 00000100:00100000:1.0:1787857076.129756:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787857076.129762:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885040768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.129916:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885040768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.129923:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787857076.130061:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885040768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.130745:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8457:1874703885040896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.130790:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.130823:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.130874:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885040896 00000100:00100000:1.0:1787857076.130879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885040896 00000100:00100000:1.0:1787857076.130908:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787857076.130915:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8457:x1874703885040896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.131109:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8457:x1874703885040896:12345-0@lo:502:llog_process_th.0 Request processed in 193us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.131116:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787857076.131398:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8457:1874703885040896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857076.131423:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857076.131437:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857076.131440:0:8457:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787857076.131447:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787857076.131467:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8457:1874703885041024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857076.131502:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857076.131522:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857076.131572:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041024 00000100:00100000:1.0:1787857076.131576:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041024 00000100:00100000:1.0:1787857076.131607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787857076.131613:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8457:x1874703885041024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857076.131812:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8457:x1874703885041024:12345-0@lo:502:llog_process_th.0 Request processed in 198us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857076.131819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787857076.131985:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8457:1874703885041024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857076.132003:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857076.132008:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857076.132010:0:8457:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787857076.132014:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787857076.132443:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787857076.132459:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787857076.132468:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.132479:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857076.132490:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787857076.132493:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fd942e119d0 from 1 10000000:01000000:1.0:1787857076.132496:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787857076.132522:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.132529:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.132537:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.132552:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885041152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.132587:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.132623:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857076.132710:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041152 00000100:00100000:2.0:1787857076.132723:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041152 00000100:00100000:2.0:1787857076.132755:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787857076.132762:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885041152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857076.132781:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857076.132793:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe80b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.132814:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe80b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.132824:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe80b expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857076.132833:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b200, rc 0) 00000100:00100000:2.0:1787857076.132869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885041152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.132876:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787857076.133170:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885041152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857076.133185:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.133200:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.133249:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885041280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857076.133420:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857076.133452:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857076.133704:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041280 00000100:00100000:3.0:1787857076.133709:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041280 00000100:00100000:3.0:1787857076.133876:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787857076.133892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885041280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857076.134145:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885041280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (725us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857076.134152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787857076.134510:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885041280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787857076.134538:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787857076.134547:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857076.134556:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857076.387743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857076.387852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993792 00000100:00100000:3.0:1787857076.387863:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993792 00000100:00100000:3.0:1787857076.387928:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:3.0:1787857076.387937:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:5594:x1874703862993792:12345-192.168.204.29@tcp:101: 00010000:00010000:3.0:1787857076.387954:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857076.387971:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882768 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.388000:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882768 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.388010:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882768 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857076.388019:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d200, rc 0) 00000100:00100000:3.0:1787857076.388209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862993792:12345-192.168.204.29@tcp:101: Request processed in 272us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857076.388217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:1.0:1787857076.413009:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857076.413210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862993920 00000100:00100000:2.0:1787857076.413224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862993920 00000100:00100000:2.0:1787857076.413292:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:2.0:1787857076.413301:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862993920:12345-192.168.204.29@tcp:501: 00000100:00100000:2.0:1787857076.413638:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862993920:12345-192.168.204.29@tcp:501: Request processed in 336us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.413646:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:2.0:1787857076.415602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857076.415695:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994048 00000100:00100000:3.0:1787857076.415705:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994048 00000100:00100000:3.0:1787857076.415759:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:3.0:1787857076.415768:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862994048:12345-192.168.204.29@tcp:503: 00000100:00100000:3.0:1787857076.416000:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862994048:12345-192.168.204.29@tcp:503: Request processed in 232us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857076.416013:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:1.0:1787857076.430725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857076.430825:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994176 00000100:00100000:0.0:1787857076.430835:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994176 00000100:00100000:0.0:1787857076.430902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:0.0:1787857076.430913:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:6073:x1874703862994176:12345-192.168.204.29@tcp:502: 00000100:00100000:0.0:1787857076.431222:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:6073:x1874703862994176:12345-192.168.204.29@tcp:502: Request processed in 309us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.431230:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:1.0:1787857076.438559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857076.438712:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994304 00000100:00100000:2.0:1787857076.438723:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994304 00000100:00100000:2.0:1787857076.438781:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:2.0:1787857076.438791:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:6073:x1874703862994304:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857076.439364:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:6073:x1874703862994304:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 572us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857076.439380:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:2.0:1787857076.449946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857076.450105:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994432 00000100:00100000:0.0:1787857076.450115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994432 00000100:00100000:0.0:1787857076.450178:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:0.0:1787857076.450188:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862994432:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857076.450206:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857076.450227:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975561c00/0xf326646fe3bbe820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88276f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.450257:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975561c00/0xf326646fe3bbe820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88276f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.450285:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975561c00/0xf326646fe3bbe820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88276f expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857076.450295:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561c00, rc 0) 00000100:00100000:0.0:1787857076.450365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994432:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 178us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857076.450372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:1.0:1787857076.459041:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857076.459356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994560 00000100:00100000:0.0:1787857076.459366:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994560 00000100:00100000:0.0:1787857076.459425:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 170 00000100:00100000:0.0:1787857076.459436:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994560:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857076.459755:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994560:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 320us (723us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857076.459764:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 170 00010000:00010000:3.0:1787857076.679844:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787857077.350753:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe960ee920 20000000:00000080:0.0:1787857077.350772:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd97bb1c400 uarg=0000000000000000 20000000:01000000:0.0:1787857077.350813:0:8494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787857077.350820:0:8494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787857077.350825:0:8494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787857077.354352:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787857077.354549:0:8494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787857077.359646:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787857077.360154:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787857077.360217:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787857077.360236:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787857077.360256:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360272:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360280:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360286:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360294:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360303:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360355:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360369:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 9 pid: 5829 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.360401:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041408:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857077.360516:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360525:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.360534:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041536:0@lo:104: 00000100:00100000:2.0:1787857077.360575:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787857077.360617:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.360626:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 18 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.360635:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8acb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041664:0@lo:104: 00000100:00100000:2.0:1787857077.361159:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857077.361199:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787857077.361212:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041536 00000100:00100000:2.0:1787857077.361218:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041536 00000100:00100000:2.0:1787857077.361256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041664 00000100:00100000:2.0:1787857077.361258:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041664 00000100:00100000:2.0:1787857077.361272:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787857077.361280:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8494:x1874703885041536:12345-0@lo:104: 00010000:00010000:2.0:1787857077.361293:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361407:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787857077.361421:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:8494:x1874703885041536:12345-0@lo:104: Request processed in 141us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857077.361428:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787857077.361444:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787857077.361451:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975b15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8494:x1874703885041664:12345-0@lo:104: 00010000:00010000:2.0:1787857077.361459:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361494:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787857077.361499:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975b15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8494:x1874703885041664:12345-0@lo:104: Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857077.361504:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787857077.361546:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857077.361552:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361559:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045c00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857077.361562:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361571:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857077.361577:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857077.361583:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857077.361620:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361635:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857077.361655:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.361678:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd982045c00/0xf326646fe3bbe6c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe6c9 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.362230:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857077.362235:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.362242:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341be00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857077.362245:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.362252:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857077.362258:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857077.362262:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857077.362280:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.362286:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857077.362371:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.362379:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341be00/0xf326646fe3bbe5f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe5fe expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857077.362427:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885041920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857077.362470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857077.365803:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885041792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857077.365953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857077.366433:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041920 00000100:00100000:1.0:1787857077.366441:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041920 00010000:00010000:1.0:1787857077.366479:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 19 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857077.366530:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885041792 00000100:00100000:1.0:1787857077.366905:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885041792 00010000:00010000:2.0:1787857077.366920:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857077.366925:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857077.366928:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 20 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.366929:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857077.366939:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857077.366952:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857077.366963:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3309:x1874703885041920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857077.366977:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857077.366986:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 20 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.366988:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.368231:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 20 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.368252:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885042048:0@lo:104: 00010000:00010000:1.0:1787857077.368373:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 20 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.368381:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787857077.368395:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857077.368417:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857077.368443:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041536:0@lo:104: 00000100:00100000:1.0:1787857077.368443:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3309:x1874703885041920:12345-0@lo:103:ldlm_bl.0 Request processed in 1482us (5972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857077.368452:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787857077.368456:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031400/0xf326646fe3bbe5fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe5f7 expref: 20 pid: 5830 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.368470:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8acb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041664:0@lo:104: 00000100:00100000:1.0:1787857077.368486:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787857077.368491:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042048 00000100:00100000:3.0:1787857077.368499:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042048 00000100:00100000:1.0:1787857077.368499:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3312:x1874703885041792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857077.368515:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857077.368521:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857077.368524:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885041920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857077.368537:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857077.368553:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbe6c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe6c2 expref: 18 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857077.368574:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857077.368623:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3312:x1874703885041792:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857077.368629:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787857077.368731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857077.368753:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994688 00000100:00100000:1.0:1787857077.368757:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994688 00010000:00010000:1.0:1787857077.368775:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 10 pid: 5829 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857077.368794:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:1.0:1787857077.368800:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862994688:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857077.368808:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857077.368813:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 10 pid: 5829 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857077.368822:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 10 pid: 5829 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857077.368834:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857077.368871:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862994688:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857077.368877:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1787857077.369137:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787857077.369148:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8494:x1874703885042048:12345-0@lo:104: 00010000:00010000:3.0:1787857077.369162:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857077.369207:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787857077.369212:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:8494:x1874703885042048:12345-0@lo:104: Request processed in 68us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857077.369793:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885041792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857077.370805:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953489c00/0xf326646fe3bbe786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882737 expref: 9 pid: 5829 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857077.370821:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885041408:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857077.370833:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1874703885042048:0@lo:104: 00010000:00010000:0.0:1787857077.370858:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372176:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857077.372190:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372201:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341aa00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857077.372205:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372215:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857077.372243:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857077.372249:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857077.372376:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372384:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857077.372417:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372424:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbe595 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe59c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857077.372441:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885042176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857077.372445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857077.372449:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857077.372451:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857077.372508:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857077.372557:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042176 00000100:00100000:2.0:1787857077.372567:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042176 00010000:00010000:2.0:1787857077.372600:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857077.372646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857077.372656:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3310:x1874703885042176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857077.372688:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857077.372694:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372707:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372732:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe59c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe595 expref: 17 pid: 5831 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372749:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372758:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372774:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372780:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372787:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372794:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372799:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341ba00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857077.372804:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372811:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372832:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857077.372851:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857077.372895:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3310:x1874703885042176:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857077.372904:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857077.372940:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885042176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857077.373064:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857077.373074:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857077.373081:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbe827 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857077.375804:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787857077.705251:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787857078.023834:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787857078.023842:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd975d01000 from 4 10000000:01000000:0.0:1787857078.023848:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787857078.023907:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.023920:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.023947:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857078.023998:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.024073:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.024150:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857078.024272:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042304 00000100:00100000:2.0:1787857078.024280:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042304 00000100:00100000:2.0:1787857078.024339:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787857078.024350:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885042304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857078.024373:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857078.024387:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe82e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.024410:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.024420:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.024429:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ac00, rc 0) 00000100:00100000:2.0:1787857078.024489:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.024495:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787857078.024644:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857078.024703:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.024724:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857078.024798:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.024828:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.024864:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857078.024994:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042432 00000100:00100000:3.0:1787857078.024998:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042432 00000100:00100000:3.0:1787857078.025021:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787857078.025029:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857078.025300:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857078.025307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787857078.025438:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.025468:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.025508:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.025532:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.025564:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042560 00000100:00100000:0.0:1787857078.025569:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042560 00000100:00100000:0.0:1787857078.025753:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787857078.025760:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.026455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 694us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.026463:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787857078.028127:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.033228:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8514:1874703885042688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857078.033326:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.033498:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857078.033720:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042688 00000100:00100000:2.0:1787857078.033728:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042688 00000100:00100000:2.0:1787857078.033815:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787857078.033831:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8514:x1874703885042688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857078.034046:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8514:x1874703885042688:12345-0@lo:502:llog_process_th.0 Request processed in 216us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.034054:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787857078.034149:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8514:1874703885042688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787857078.034176:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857078.034186:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857078.034188:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787857078.034195:0:8514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd975d01000 00000020:00000080:1.0:1787857078.034197:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787857078.034288:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8514:1874703885042816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857078.034326:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.035169:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.035272:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042816 00000100:00100000:0.0:1787857078.035279:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042816 00000100:00100000:0.0:1787857078.035309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787857078.035317:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8514:x1874703885042816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857078.035862:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:8514:x1874703885042816:12345-0@lo:502:llog_process_th.0 Request processed in 544us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.035870:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787857078.036219:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8514:1874703885042816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787857078.036255:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857078.036262:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857078.036264:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787857078.036269:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787857078.037258:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787857078.037281:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787857078.037292:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.037303:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857078.037313:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787857078.037324:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd950737800 from 4 10000000:01000000:0.0:1787857078.037327:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787857078.037360:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.037436:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.037446:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857078.037531:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.037769:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.037867:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857078.037974:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885042944 00000100:00100000:2.0:1787857078.037981:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885042944 00000100:00100000:2.0:1787857078.038063:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787857078.038072:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885042944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857078.038084:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857078.038098:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe83c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.038213:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.038225:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.038233:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341aa00, rc 0) 00000100:00100000:2.0:1787857078.038321:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885042944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.038328:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787857078.038458:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885042944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857078.038541:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.038561:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857078.038788:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.038817:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.038881:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857078.038985:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043072 00000100:00100000:2.0:1787857078.038990:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043072 00000100:00100000:2.0:1787857078.039023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787857078.039030:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885043072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857078.039498:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885043072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.039511:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787857078.039859:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.039906:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.039947:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.039978:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.039998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043200 00000100:00100000:0.0:1787857078.040002:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043200 00000100:00100000:0.0:1787857078.040025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787857078.040031:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885043200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.040351:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885043200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.040359:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787857078.040744:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.041739:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8516:1874703885043328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857078.041794:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.041865:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857078.041961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043328 00000100:00100000:1.0:1787857078.041967:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043328 00000100:00100000:1.0:1787857078.042010:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787857078.042019:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8516:x1874703885043328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857078.042833:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8516:x1874703885043328:12345-0@lo:502:llog_process_th.0 Request processed in 813us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857078.042841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787857078.043813:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8516:1874703885043328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857078.043848:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857078.043860:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857078.043862:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787857078.043870:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd950737800 00000020:00000080:0.0:1787857078.043883:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787857078.043973:0:8516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8516:1874703885043456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857078.044029:0:8516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.044060:0:8516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857078.052492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043456 00000100:00100000:1.0:1787857078.052505:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043456 00000100:00100000:1.0:1787857078.052570:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787857078.052578:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8516:x1874703885043456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857078.053082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:8516:x1874703885043456:12345-0@lo:502:llog_process_th.0 Request processed in 503us (9052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857078.053089:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787857078.060842:0:8516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8516:1874703885043456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857078.060895:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857078.060903:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857078.060906:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787857078.060911:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787857078.061023:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787857078.061043:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857078.061054:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.061065:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857078.061076:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857078.061078:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96116a000 from 4 10000000:01000000:1.0:1787857078.061090:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857078.061141:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.061150:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.061158:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857078.061180:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.061240:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.061284:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.063110:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043584 00000100:00100000:0.0:1787857078.063140:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043584 00000100:00100000:0.0:1787857078.063213:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787857078.063224:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885043584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857078.063241:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857078.063260:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe84a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.063286:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.063298:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857078.063307:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857078.063381:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885043584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.063388:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787857078.063468:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857078.063486:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.063495:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857078.063568:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.063618:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857078.063655:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857078.064063:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043712 00000100:00100000:2.0:1787857078.064068:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043712 00000100:00100000:2.0:1787857078.064105:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787857078.064113:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885043712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857078.064375:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885043712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.064382:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787857078.064456:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.064488:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.064528:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857078.064612:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043840 00000100:00100000:0.0:1787857078.064616:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043840 00000100:00100000:0.0:1787857078.064651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787857078.064795:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885043840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857078.064862:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.064935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885043840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.064942:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787857078.065056:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885043840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857078.077011:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8518:1874703885043968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857078.077091:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857078.077141:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.077246:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885043968 00000100:00100000:0.0:1787857078.077253:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885043968 00000100:00100000:0.0:1787857078.077304:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787857078.077329:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:8518:x1874703885043968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857078.077542:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:8518:x1874703885043968:12345-0@lo:502:llog_process_th.0 Request processed in 214us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.077550:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787857078.077642:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8518:1874703885043968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857078.077871:0:8518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857078.077886:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857078.077888:0:8518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787857078.077895:0:8518:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96116a000 00000020:00000080:3.0:1787857078.077898:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787857078.077953:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8518:1874703885044096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857078.080108:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857078.080151:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857078.080305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044096 00000100:00100000:0.0:1787857078.080315:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044096 00000100:00100000:0.0:1787857078.080361:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787857078.080370:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:8518:x1874703885044096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857078.080622:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:8518:x1874703885044096:12345-0@lo:502:llog_process_th.0 Request processed in 252us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.080630:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787857078.085476:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:8518:1874703885044096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857078.085585:0:8518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857078.085611:0:8518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857078.085614:0:8518:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787857078.085618:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787857078.088247:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787857078.088288:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857078.088299:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857078.088310:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857078.443413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857078.443530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994816 00000100:00100000:2.0:1787857078.443539:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994816 00000100:00100000:2.0:1787857078.443608:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 186 00000100:00100000:2.0:1787857078.443618:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:5594:x1874703862994816:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857078.443636:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857078.443655:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882776 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.443707:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.443720:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857078.443730:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b400, rc 0) 00000100:00100000:2.0:1787857078.443795:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994816:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 178us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.443814:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 186 00000100:00100000:1.0:1787857078.450835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857078.451001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862994944 00000100:00100000:2.0:1787857078.451011:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862994944 00000100:00100000:2.0:1787857078.451067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 187 00000100:00100000:2.0:1787857078.451077:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994944:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857078.451338:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862994944:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 261us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.451346:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 187 00000100:00100000:2.0:1787857078.465626:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857078.468999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995072 00000100:00100000:0.0:1787857078.469013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995072 00000100:00100000:0.0:1787857078.469076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:0.0:1787857078.469085:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862995072:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857078.469296:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:5594:x1874703862995072:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 211us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.469304:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:0.0:1787857078.474792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857078.474855:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995200 00000100:00100000:0.0:1787857078.474864:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995200 00000100:00100000:0.0:1787857078.474923:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:0.0:1787857078.474933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:6126:x1874703862995200:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857078.475158:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:6126:x1874703862995200:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 226us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857078.475166:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:0.0:1787857078.490833:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857078.493968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995328 00000100:00100000:2.0:1787857078.493983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995328 00000100:00100000:2.0:1787857078.494309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 190 00000100:00100000:2.0:1787857078.494321:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:6126:x1874703862995328:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857078.497841:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:6126:x1874703862995328:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 3511us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857078.497856:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 190 00010000:00010000:2.0:1787857078.730787:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857079.757123:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857080.136638:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885044480:0@lo:400:kworker.0 00000100:00100000:3.0:1787857080.136738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857080.136803:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857080.136810:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885044608:0@lo:400:kworker.0 00000100:00100000:3.0:1787857080.136836:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857080.136878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044480 00000100:00100000:0.0:1787857080.136988:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885044224:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857080.137046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885044736:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857080.137086:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787857080.137091:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885044352:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857080.137142:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885044864:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137162:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857080.137195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044224 00000100:00100000:0.0:1787857080.137202:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044224 00000100:00100000:0.0:1787857080.137254:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787857080.137262:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885044224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885044224:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857080.137319:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787857080.137350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044736 00000100:00100000:0.0:1787857080.137354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044736 00000100:00100000:0.0:1787857080.137390:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044352 00000100:00100000:0.0:1787857080.137393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044352 00000100:00100000:0.0:1787857080.137405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857080.137412:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137443:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885044736:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857080.137449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857080.137480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787857080.137485:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885044352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137514:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885044352:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857080.137519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787857080.137535:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044608 00000100:00100000:0.0:1787857080.137538:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044608 00000100:00100000:0.0:1787857080.137578:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044864 00000100:00100000:0.0:1787857080.137581:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044864 00000100:00100000:0.0:1787857080.137598:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787857080.137604:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885044608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137638:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885044608:12345-0@lo:400:kworker.0 Request processed in 34us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857080.137645:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787857080.137655:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857080.137697:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885044864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137723:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885044864:12345-0@lo:400:kworker.0 Request processed in 63us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857080.137729:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857080.137770:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885044352:0@lo:400:kworker.0 00010000:00080000:0.0:1787857080.137784:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d8b40 x1874703885044864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857080.137795:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885044864:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137803:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885044224:0@lo:400:kworker.0 00000100:00100000:0.0:1787857080.137812:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885044736:0@lo:400:kworker.0 00000100:00100000:3.0:1787857080.138078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044480 00000100:00100000:3.0:1787857080.138174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857080.138182:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857080.138220:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885044480:12345-0@lo:400:kworker.0 Request processed in 41us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857080.138227:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787857080.138264:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d9e00 x1874703885044608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857080.138276:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885044608:0@lo:400:kworker.0 00000100:00100000:3.0:1787857080.138296:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885044480:0@lo:400:kworker.0 00000100:00080000:1.0:1787857080.138752:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857080.138758:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857080.138761:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857080.139062:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857080.139075:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857080.139356:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857080.139586:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885044992 00000100:00100000:1.0:1787857080.139592:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885044992 00000100:00100000:1.0:1787857080.139636:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857080.139644:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885044992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857080.139710:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857080.139761:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885044992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857080.139768:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787857080.143758:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8af840 x1874703885044992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857080.143789:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857080.673438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857080.673485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857080.673511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995456 00000100:00100000:2.0:1787857080.673522:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995456 00000100:00100000:0.0:1787857080.673527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857080.673579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857080.673599:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995712 00000100:00100000:2.0:1787857080.673603:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 192 00000100:00100000:1.0:1787857080.673605:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995712 00000100:00100000:1.0:1787857080.673654:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995840 00000100:00100000:1.0:1787857080.673706:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995840 00000100:00100000:2.0:1787857080.673714:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862995456:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857080.673739:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1787857080.673748:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862995712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857080.673800:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862995456:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 184us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857080.673801:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862995712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857080.673815:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1787857080.673849:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1787857080.673858:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862995840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857080.673865:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995584 00000100:00100000:3.0:1787857080.673872:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995584 00000100:00100000:1.0:1787857080.673908:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703862995840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857080.673914:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1787857080.673924:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862995584:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857080.673927:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00080000:1.0:1787857080.673950:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857080.673956:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857080.673958:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857080.673966:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862995584:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857080.673974:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:2.0:1787857080.684643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 192 00010000:00010000:2.0:1787857080.775824:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857081.165488:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857081.165511:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857081.165595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857081.165684:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045120 00000100:00100000:1.0:1787857081.165691:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045120 00000100:00100000:1.0:1787857081.165738:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857081.165747:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885045120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857081.165782:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857081.165829:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885045120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857081.165837:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787857081.165884:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6c000 x1874703885045120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857081.165903:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885045120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857081.800328:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857082.824000:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857083.849305:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787857083.855150:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857084.872716:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857085.256062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857085.256088:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885045248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857085.256544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857085.256931:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045248 00000100:00100000:1.0:1787857085.256938:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045248 00000100:00100000:1.0:1787857085.256988:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857085.256997:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885045248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857085.257045:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857085.257091:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885045632:0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.257091:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885045248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.257098:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787857085.257127:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857085.257150:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857085.257156:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885045504:0@lo:400:kworker.0 00000100:00100000:2.0:1787857085.257177:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857085.257213:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045632 00000100:00100000:2.0:1787857085.257217:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045632 00000100:00080000:1.0:1787857085.257236:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857085.257240:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857085.257278:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885045376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857085.257309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857085.257334:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885045888:0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.257417:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045376 00000100:00100000:1.0:1787857085.257421:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045376 00000100:00100000:1.0:1787857085.257447:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787857085.257465:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885045376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.257507:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885045376:12345-0@lo:400:kworker.0 Request processed in 45us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.257523:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787857085.257568:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885045760:0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.257594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857085.257625:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045760 00000100:00100000:1.0:1787857085.257629:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045760 00000100:00100000:1.0:1787857085.257683:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857085.257690:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.257724:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885045760:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.257730:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787857085.257745:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787857085.257825:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8ac3c0 x1874703885045760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857085.257840:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885045760:0@lo:400:kworker.0 00000100:00100000:0.0:1787857085.259464:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787857085.278826:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96ddd7c00 x1874703885045248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857085.278866:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885045248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857085.279086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045888 00000100:00100000:2.0:1787857085.279086:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885045504 00000100:00100000:3.0:1787857085.279094:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045888 00000100:00100000:2.0:1787857085.279095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885045504 00000100:00100000:3.0:1787857085.279120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787857085.279132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885045632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857085.279142:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787857085.279152:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885045504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857085.279210:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885045376:0@lo:400:kworker.0 00000100:00100000:1.0:1787857085.288029:0:8075:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857085.288046:0:8075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787857085.288060:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857085.288073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787857085.288084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885045888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857085.288205:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857085.288715:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885045632:12345-0@lo:400:kworker.0 Request processed in 9584us (31584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857085.288725:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787857085.288937:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885045632:0@lo:400:kworker.0 00000100:00100000:3.0:1787857085.289307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885045888:12345-0@lo:400:kworker.0 Request processed in 1224us (29853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857085.289314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787857085.289568:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885045888:0@lo:400:kworker.0 00000100:00100000:2.0:1787857085.294378:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885045504:12345-0@lo:400:kworker.0 Request processed in 15212us (37182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857085.294396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857085.294417:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885045504:0@lo:400:kworker.0 00000100:00100000:0.0:1787857085.793034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857085.793965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857085.794000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857085.794046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857085.796024:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862995968 00000100:00100000:1.0:1787857085.796037:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862995968 00000100:00100000:1.0:1787857085.796098:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:1.0:1787857085.796110:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862995968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857085.796263:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862995968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 154us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.796271:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:1.0:1787857085.796467:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996224 00000100:00100000:1.0:1787857085.796472:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996224 00000100:00100000:1.0:1787857085.796513:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996352 00000100:00100000:1.0:1787857085.796516:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996352 00000100:00100000:1.0:1787857085.796621:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1787857085.796629:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862996224:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857085.796696:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862996224:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 68us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.796703:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1787857085.796716:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1787857085.796723:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862996352:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857085.796749:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703862996352:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.796755:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00080000:1.0:1787857085.797044:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857085.797049:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857085.798091:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996096 00000100:00100000:2.0:1787857085.798112:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996096 00000100:00080000:1.0:1787857085.798219:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857085.798429:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:1.0:1787857085.798452:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862996096:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857085.798524:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862996096:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857085.798540:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00010000:00010000:2.0:1787857085.898127:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857086.282065:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885046016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857086.282142:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857086.282246:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046016 00000100:00100000:3.0:1787857086.282254:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046016 00000100:00100000:3.0:1787857086.282299:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787857086.282308:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885046016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857086.282344:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857086.282395:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885046016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857086.282403:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787857086.282458:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769db840 x1874703885046016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857086.282477:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885046016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857086.919787:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857087.944939:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857088.973619:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857089.108582:0:9038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing yml_node 00010000:00010000:0.0:1787857089.992133:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857090.376860:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885046528:0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.376937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857090.376999:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857090.377005:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885046144:0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857090.377057:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885046656:0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857090.377109:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046528 00000100:00100000:3.0:1787857090.377116:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046528 00000100:00100000:3.0:1787857090.377181:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787857090.377191:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885046528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377252:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885046528:12345-0@lo:400:kworker.0 Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.377259:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787857090.377281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046144 00000100:00100000:3.0:1787857090.377285:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046144 00000100:00100000:3.0:1787857090.377306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787857090.377313:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885046144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377341:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885046144:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.377368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787857090.377398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046656 00000100:00100000:3.0:1787857090.377402:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046656 00000100:00100000:3.0:1787857090.377429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787857090.377435:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885046656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377466:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885046656:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.377473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787857090.377489:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857090.377494:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857090.377526:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885046144:0@lo:400:kworker.0 00000100:00100000:3.0:1787857090.377540:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885046656:0@lo:400:kworker.0 00000100:00100000:0.0:1787857090.377547:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885046400:0@lo:400:kworker.0 00010000:00080000:3.0:1787857090.377551:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8ae940 x1874703885046528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857090.377561:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885046528:0@lo:400:kworker.0 00000100:00100000:0.0:1787857090.377577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857090.377602:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857090.377608:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885046272:0@lo:400:kworker.0 00000100:00100000:2.0:1787857090.377724:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046400 00000100:00100000:2.0:1787857090.377729:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046400 00000100:00100000:2.0:1787857090.377761:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787857090.377768:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885046400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857090.377804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885046400:12345-0@lo:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857090.377811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787857090.377901:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857090.378974:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857090.378991:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885046912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857090.379046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857090.379173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857090.379328:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046912 00000100:00100000:1.0:1787857090.379334:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046912 00000100:00100000:1.0:1787857090.379395:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787857090.379404:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885046912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857090.379438:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857090.379487:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885046912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857090.379493:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787857090.379528:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857090.379992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885046784:0@lo:400:kworker.0 00000100:00100000:0.0:1787857090.380087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857090.380128:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885046400:0@lo:400:kworker.0 00000100:00100000:0.0:1787857090.380151:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046784 00000100:00100000:0.0:1787857090.380155:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046784 00000100:00100000:0.0:1787857090.380180:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857090.380186:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885046784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857090.380800:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885046272 00000100:00100000:2.0:1787857090.380806:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885046272 00000100:00100000:2.0:1787857090.380909:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787857090.380918:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885046272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857090.384341:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885046272:12345-0@lo:400:kworker.0 Request processed in 3415us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857090.384365:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787857090.387967:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885046784:12345-0@lo:400:kworker.0 Request processed in 7770us (7869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857090.387983:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857090.388050:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885046272:0@lo:400:kworker.0 00010000:00080000:0.0:1787857090.388065:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8ade00 x1874703885046784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857090.388076:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885046784:0@lo:400:kworker.0 00010000:00080000:3.0:1787857090.391924:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6e940 x1874703885046912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857090.391959:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885046912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857090.917910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857090.917986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857090.918088:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996480 00000100:00100000:1.0:1787857090.918099:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996480 00000100:00100000:1.0:1787857090.918183:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:1.0:1787857090.918194:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862996480:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857090.918289:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862996480:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857090.918297:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:3.0:1787857090.919981:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996608 00000100:00100000:3.0:1787857090.920006:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996608 00000100:00100000:3.0:1787857090.920097:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1787857090.920108:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862996608:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857090.920196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862996608:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 91us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.920224:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00080000:1.0:1787857090.920788:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857090.928572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857090.929104:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996736 00000100:00100000:3.0:1787857090.929117:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996736 00000100:00100000:3.0:1787857090.929210:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857090.929221:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2351:x1874703862996736:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:3.0:1787857090.929267:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe794 00000100:00080000:3.0:1787857090.929279:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9fd9497f7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787857090.929329:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1787857090.929753:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857090.930103:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857090.930498:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+2:2351:x1874703862996736:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 1274us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.930508:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857090.935306:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857090.935395:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996864 00000100:00100000:3.0:1787857090.935405:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996864 00000100:00100000:3.0:1787857090.935487:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00080000:2.0:1787857090.935488:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857090.935499:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2351:x1874703862996864:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:3.0:1787857090.935545:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe79b 00000100:00080000:3.0:1787857090.935555:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9fd9497f6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787857090.935603:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787857090.935928:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857090.936038:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+2:2351:x1874703862996864:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 541us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857090.936047:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00010000:00010000:0.0:1787857091.015947:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857091.400247:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885047040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857091.400348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857091.400767:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047040 00000100:00100000:3.0:1787857091.400775:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047040 00000100:00100000:3.0:1787857091.400827:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787857091.400837:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885047040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857091.400877:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857091.400945:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885047040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857091.400953:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787857091.401081:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d8b40 x1874703885047040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857091.401100:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885047040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857092.040447:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857093.065053:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857093.173411:0:9230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.81 00000001:00100000:0.0:1787857094.004025:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:0.0:1787857094.004033:0:7626:0:(genops.c:885:class_export_put()) final put ffff9fd9497f5800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857094.004203:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9497f5800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-OST0001 00000020:00000080:2.0:1787857094.004254:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9497f6800 for lustre-OST0001 00010000:00010000:2.0:1787857094.089614:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857095.112132:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857095.505330:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885047552:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.505809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.505873:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787857095.505881:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885047168:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.505926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.506026:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885047680:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506056:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.506099:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885047424:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.506154:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857095.506161:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885047296:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.506201:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885047808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857095.506281:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047168 00000100:00100000:0.0:1787857095.506289:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047168 00000100:00100000:0.0:1787857095.506353:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787857095.506362:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885047168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506424:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885047168:12345-0@lo:400:kworker.0 Request processed in 62us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506432:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787857095.506465:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047680 00000100:00100000:0.0:1787857095.506469:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047680 00000100:00100000:0.0:1787857095.506505:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047424 00000100:00100000:0.0:1787857095.506508:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047424 00000100:00100000:0.0:1787857095.506524:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047296 00000100:00100000:0.0:1787857095.506527:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047296 00000100:00100000:0.0:1787857095.506540:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787857095.506545:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885047680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506575:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885047680:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506581:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787857095.506593:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787857095.506598:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885047424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506628:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885047424:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506634:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787857095.506644:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857095.506649:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885047296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506700:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885047296:12345-0@lo:400:kworker.0 Request processed in 50us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506705:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857095.506727:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047552 00000100:00100000:0.0:1787857095.506737:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047552 00000100:00100000:0.0:1787857095.506764:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047808 00000100:00100000:0.0:1787857095.506766:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047808 00000100:00100000:0.0:1787857095.506783:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857095.506788:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506815:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885047552:12345-0@lo:400:kworker.0 Request processed in 27us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506821:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857095.506830:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857095.506835:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885047808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506853:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885047808:12345-0@lo:400:kworker.0 Request processed in 19us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857095.506859:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857095.506883:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885047168:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506894:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885047680:0@lo:400:kworker.0 00010000:00080000:0.0:1787857095.506905:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769dad00 x1874703885047552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857095.506915:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885047552:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506939:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885047296:0@lo:400:kworker.0 00010000:00080000:0.0:1787857095.506958:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d9680 x1874703885047808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857095.506968:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885047808:0@lo:400:kworker.0 00000100:00100000:0.0:1787857095.506976:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885047424:0@lo:400:kworker.0 00000100:00080000:2.0:1787857095.507156:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857095.507160:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857095.507163:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857095.509524:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857095.509544:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885047936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857095.509602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857095.509693:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885047936 00000100:00100000:1.0:1787857095.509702:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885047936 00000100:00100000:1.0:1787857095.509749:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857095.509771:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885047936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857095.509902:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857095.510019:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885047936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 261us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857095.510027:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787857095.510153:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6e580 x1874703885047936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857095.510174:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885047936:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787857095.562229:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857095.562241:0:6702:0:(genops.c:885:class_export_put()) final put ffff9fd9497f3800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:3.0:1787857095.562307:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9497f3800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-OST0000 00000020:00000080:3.0:1787857095.562356:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9497f7800 for lustre-OST0000 00000001:02000400:1.0:1787857095.570119:0:9330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.81 00000100:00100000:1.0:1787857096.045003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857096.046412:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862996992 00000100:00100000:2.0:1787857096.046426:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862996992 00000100:00100000:2.0:1787857096.046497:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:2.0:1787857096.046509:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862996992:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857096.046606:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2355:x1874703862996992:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 99us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857096.046613:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:2.0:1787857096.065221:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857096.065330:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997120 00000100:00100000:0.0:1787857096.065354:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997120 00000100:00100000:0.0:1787857096.065436:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1787857096.065446:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862997120:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857096.065542:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703862997120:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857096.065550:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00080000:2.0:1787857096.065615:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857096.139715:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857096.521389:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885048064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857096.521459:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857096.522583:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048064 00000100:00100000:3.0:1787857096.522591:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048064 00000100:00100000:3.0:1787857096.522648:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787857096.522676:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885048064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857096.522714:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857096.522891:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885048064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857096.522899:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787857096.522943:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d9e00 x1874703885048064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857096.522961:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885048064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857097.160197:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857097.914267:0:9428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.81 00010000:00010000:3.0:1787857098.184132:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857099.208796:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857099.272214:0:9476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 14:58:17 EDT 2026 00010000:00010000:2.0:1787857100.233624:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857100.615892:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885048192:0@lo:400:kworker.0 00000100:00100000:0.0:1787857100.615964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857100.616170:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857100.616178:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885048576:0@lo:400:kworker.0 00000100:00100000:0.0:1787857100.616208:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857100.616243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048192 00000100:00100000:0.0:1787857100.616249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048192 00000100:00100000:0.0:1787857100.616293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787857100.616301:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885048192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857100.616351:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885048192:12345-0@lo:400:kworker.0 Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857100.616358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787857100.616395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048576 00000100:00100000:0.0:1787857100.616399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048576 00000100:00100000:0.0:1787857100.616435:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787857100.616441:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885048576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857100.616487:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885048576:12345-0@lo:400:kworker.0 Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857100.616504:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787857100.616535:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857100.616566:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885048576:0@lo:400:kworker.0 00000100:00100000:0.0:1787857100.616576:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885048192:0@lo:400:kworker.0 00000100:00100000:1.0:1787857100.616961:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885048320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857100.616997:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857100.617020:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857100.617026:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885048448:0@lo:400:kworker.0 00000100:00100000:1.0:1787857100.617046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857100.617075:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048320 00000100:00100000:1.0:1787857100.617079:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048320 00000100:00080000:0.0:1787857100.617107:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857100.617113:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787857100.617120:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885048320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857100.617144:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857100.617199:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885048320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857100.617205:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787857100.617917:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857100.617929:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885048704:0@lo:400:kworker.0 00000100:00100000:3.0:1787857100.617971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857100.618001:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857100.618008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885048832:0@lo:400:kworker.0 00000100:00100000:3.0:1787857100.618029:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787857100.620282:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6d2c0 x1874703885048320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857100.620310:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885048320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857100.620346:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048704 00000100:00100000:0.0:1787857100.620352:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048704 00000100:00100000:0.0:1787857100.620404:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857100.620411:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885048704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857100.621113:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048448 00000100:00100000:2.0:1787857100.621121:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048448 00000100:00100000:2.0:1787857100.621165:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048832 00000100:00100000:2.0:1787857100.621168:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048832 00000100:00100000:2.0:1787857100.621192:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857100.621198:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885048448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857100.621273:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885048448:12345-0@lo:400:kworker.0 Request processed in 75us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857100.621280:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857100.621296:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857100.621302:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885048832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857100.621345:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874703885048832:12345-0@lo:400:kworker.0 Request processed in 43us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857100.621350:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857100.621386:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874703885048832:0@lo:400:kworker.0 00000100:00080000:2.0:1787857100.621407:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857100.621411:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857100.621689:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885048704:12345-0@lo:400:kworker.0 Request processed in 1277us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857100.621698:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857100.621726:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885048448:0@lo:400:kworker.0 00010000:00080000:0.0:1787857100.621730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769dbc00 x1874703885048704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857100.621742:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885048704:0@lo:400:kworker.0 00000100:00100000:3.0:1787857101.152264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857101.152319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857101.152367:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997376 00000100:00100000:1.0:1787857101.152389:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997376 00000100:00100000:1.0:1787857101.152462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:1.0:1787857101.152472:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703862997376:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857101.152544:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769da1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703862997376:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857101.152551:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:1.0:1787857101.152585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997248 00000100:00100000:1.0:1787857101.152588:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997248 00000100:00100000:1.0:1787857101.152613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:1.0:1787857101.152619:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862997248:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857101.152644:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703862997248:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857101.152650:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00080000:3.0:1787857101.152976:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857101.255865:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857101.642607:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885048960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857101.642723:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857101.642869:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885048960 00000100:00100000:3.0:1787857101.642878:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885048960 00000100:00100000:3.0:1787857101.642936:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787857101.642946:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885048960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857101.642986:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857101.643046:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885048960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857101.643056:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787857101.643099:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769d9e00 x1874703885048960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857101.643119:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885048960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857102.284914:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857103.303888:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857104.329121:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857105.353040:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857105.736959:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885049216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737123:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885049728:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787857105.737189:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885049088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737238:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885049600:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737287:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885049344:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737325:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857105.737331:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885049472:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857105.737378:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049216 00000100:00100000:0.0:1787857105.737384:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049216 00000100:00100000:0.0:1787857105.737423:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049600 00000100:00100000:0.0:1787857105.737426:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049600 00000100:00100000:0.0:1787857105.737447:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049344 00000100:00100000:0.0:1787857105.737450:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049344 00000100:00100000:0.0:1787857105.737466:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787857105.737474:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885049216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737523:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885049216:12345-0@lo:400:kworker.0 Request processed in 50us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.737531:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787857105.737547:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787857105.737553:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737581:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885049600:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.737598:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787857105.737610:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787857105.737616:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737648:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885049344:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.737654:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787857105.737715:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049728 00000100:00100000:0.0:1787857105.737719:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049728 00000100:00100000:0.0:1787857105.737742:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049472 00000100:00100000:0.0:1787857105.737745:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049472 00000100:00100000:0.0:1787857105.737762:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787857105.737769:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885049728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737800:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885049728:12345-0@lo:400:kworker.0 Request processed in 31us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.737806:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787857105.737818:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787857105.737824:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.737850:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885049472:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.737857:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787857105.737874:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049088 00000100:00100000:0.0:1787857105.737878:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049088 00000100:00100000:0.0:1787857105.737898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787857105.737904:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885049088:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787857105.738286:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857105.738292:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857105.738294:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857105.738604:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857105.738616:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885049856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857105.738655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857105.738825:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049856 00000100:00100000:1.0:1787857105.738830:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049856 00000100:00100000:1.0:1787857105.738879:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787857105.738887:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885049856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857105.738916:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857105.738963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885049856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857105.738969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787857105.739104:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6de00 x1874703885049856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857105.739121:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885049856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857105.740138:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885049088:12345-0@lo:400:kworker.0 Request processed in 2227us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857105.740163:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:0.0:1787857105.740257:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fa5b0c0 x1874703885049472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857105.740269:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885049472:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.740281:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885049344:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.740315:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885049088:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.740326:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885049600:0@lo:400:kworker.0 00000100:00100000:0.0:1787857105.740337:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885049216:0@lo:400:kworker.0 00010000:00080000:0.0:1787857105.740346:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fa58f00 x1874703885049728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857105.740353:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885049728:0@lo:400:kworker.0 00000100:00100000:3.0:1787857106.273555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857106.273606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857106.273689:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997504 00000100:00100000:0.0:1787857106.273690:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997632 00000100:00100000:1.0:1787857106.273700:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997504 00000100:00100000:0.0:1787857106.273700:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997632 00000100:00100000:1.0:1787857106.273758:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:0.0:1787857106.273758:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:1.0:1787857106.273767:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862997504:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857106.273767:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862997632:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1787857106.273854:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857106.273939:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703862997504:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 172us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857106.273948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:0.0:1787857106.280358:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862997632:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 6579us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857106.280374:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00010000:00010000:2.0:1787857106.378297:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857106.762733:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857106.762755:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857106.762826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857106.762902:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885049984 00000100:00100000:3.0:1787857106.762910:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885049984 00000100:00100000:3.0:1787857106.762962:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857106.762970:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885049984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857106.763007:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857106.763075:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769da940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885049984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857106.763083:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787857106.763236:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769dbc00 x1874703885049984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857106.763258:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885049984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857107.405164:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857108.424926:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857109.448226:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857110.479772:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857110.857338:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885050368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.857410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857110.857473:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857110.857479:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885050496:0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.857505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857110.857512:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885050112:0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857110.857551:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050368 00000100:00100000:1.0:1787857110.857558:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050368 00000100:00100000:0.0:1787857110.857569:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885050624:0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857110.857611:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050624 00000100:00100000:0.0:1787857110.857611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857110.857614:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050624 00000100:00100000:0.0:1787857110.857616:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885050240:0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857110.857642:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787857110.857650:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857653:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885050752:0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857110.857717:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885050368:12345-0@lo:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857110.857724:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787857110.857727:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050112 00000100:00100000:0.0:1787857110.857730:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050112 00000100:00100000:1.0:1787857110.857739:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050240 00000100:00100000:1.0:1787857110.857741:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050240 00000100:00100000:1.0:1787857110.857753:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787857110.857753:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787857110.857759:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885050624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.857759:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885050112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.857790:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885050624:12345-0@lo:400:kworker.0 Request processed in 31us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857110.857795:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787857110.857807:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787857110.857813:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.859904:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885050112:12345-0@lo:400:kworker.0 Request processed in 2134us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857110.859918:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787857110.860008:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050496 00000100:00100000:0.0:1787857110.860018:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050496 00000100:00100000:0.0:1787857110.860063:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050752 00000100:00100000:0.0:1787857110.860067:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050752 00000100:00100000:0.0:1787857110.860097:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787857110.860106:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885050496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.860174:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885050496:12345-0@lo:400:kworker.0 Request processed in 70us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857110.860205:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787857110.860220:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857110.860227:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885050752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.860256:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885050752:12345-0@lo:400:kworker.0 Request processed in 31us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857110.860262:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787857110.860838:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857110.860844:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857110.860847:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857110.865273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857110.865347:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787857110.865426:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6f0c0 x1874703885050496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857110.865441:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885050496:0@lo:400:kworker.0 00000100:00100000:2.0:1787857110.865456:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885050368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.867070:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885050240:12345-0@lo:400:kworker.0 Request processed in 9249us (9424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857110.867083:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787857110.867255:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885050240:0@lo:400:kworker.0 00010000:00080000:1.0:1787857110.867269:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6de00 x1874703885050752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857110.867280:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885050752:0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.867290:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885050112:0@lo:400:kworker.0 00000100:00100000:1.0:1787857110.867301:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885050624:0@lo:400:kworker.0 00000100:00100000:0.0:1787857110.874046:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885050880 00000100:00100000:0.0:1787857110.874062:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885050880 00000100:00100000:0.0:1787857110.874125:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787857110.874134:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885050880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857110.874170:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857110.874299:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8af0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885050880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (8951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857110.874307:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787857110.877817:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9759d0780 x1874703885050880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857110.877848:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885050880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857111.393040:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857111.393076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857111.393276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997888 00000100:00100000:0.0:1787857111.393286:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997888 00000100:00100000:0.0:1787857111.393356:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:0.0:1787857111.393366:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703862997888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857111.393453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703862997888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857111.393461:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00080000:3.0:1787857111.394174:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857111.394774:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862997760 00000100:00100000:2.0:1787857111.394783:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862997760 00000100:00100000:2.0:1787857111.394831:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:2.0:1787857111.394842:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2354:x1874703862997760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857111.395143:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2354:x1874703862997760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 302us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857111.395152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 204 00010000:00010000:2.0:1787857111.495916:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857111.881559:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857111.881587:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885051008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857111.881724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857111.882031:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051008 00000100:00100000:0.0:1787857111.882039:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051008 00000100:00100000:0.0:1787857111.882124:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857111.882133:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885051008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857111.882168:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857111.882225:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885051008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857111.882233:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787857111.882481:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9769dbc00 x1874703885051008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857111.882500:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769dbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885051008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857112.519952:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857113.543780:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857113.990848:0:10107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:58:32 (1787857112) === 00000100:00100000:3.0:1787857114.346332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857114.346598:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998016 00000100:00100000:0.0:1787857114.346609:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998016 00000100:00100000:0.0:1787857114.346699:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:0.0:1787857114.346710:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:8126:x1874703862998016:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787857114.346726:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857114.346742:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975560400/0xf326646fe3bbe85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88277d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857114.346770:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975560400/0xf326646fe3bbe85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88277d expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857114.346783:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975560400/0xf326646fe3bbe85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88277d expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857114.346792:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560400, rc 0) 00000100:00100000:0.0:1787857114.346864:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998016:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 155us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857114.346871:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:3.0:1787857114.348593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857114.348714:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998144 00000100:00100000:0.0:1787857114.348722:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998144 00000100:00100000:0.0:1787857114.348768:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:0.0:1787857114.348794:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998144:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787857114.349374:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998144:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 580us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857114.349382:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:3.0:1787857114.354391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.354482:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998272 00000100:00100000:1.0:1787857114.354491:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998272 00000100:00100000:1.0:1787857114.354555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:1.0:1787857114.354564:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998272:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787857114.358073:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998272:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 3498us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.358088:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:0.0:1787857114.368734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.368978:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998400 00000100:00100000:2.0:1787857114.368987:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998400 00000100:00100000:2.0:1787857114.369924:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:2.0:1787857114.369938:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8130:x1874703862998400:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857114.370457:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8130:x1874703862998400:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 521us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.370465:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:3.0:1787857114.386352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.386466:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998528 00000100:00100000:1.0:1787857114.386476:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998528 00000100:00100000:1.0:1787857114.386643:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:1.0:1787857114.386655:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8130:x1874703862998528:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857114.387403:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8130:x1874703862998528:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 748us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.387412:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:3.0:1787857114.391522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.391961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998656 00000100:00100000:2.0:1787857114.391971:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998656 00000100:00100000:2.0:1787857114.392157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:2.0:1787857114.392169:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:8126:x1874703862998656:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787857114.392188:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857114.392213:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827a7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.392265:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827a7 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.392276:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827a7 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.392285:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a600, rc 0) 00000100:00100000:2.0:1787857114.392337:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:8126:x1874703862998656:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 171us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.392344:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:0.0:1787857114.396274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.396435:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998784 00000100:00100000:1.0:1787857114.396444:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998784 00000100:00100000:1.0:1787857114.396500:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:1.0:1787857114.396508:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:8126:x1874703862998784:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787857114.396550:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787857114.396576:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787857114.396580:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787857114.396584:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787857114.396586:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787857114.398943:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:8126:x1874703862998784:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 2421us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.398956:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:0.0:1787857114.402515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.402654:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862998912 00000100:00100000:2.0:1787857114.402689:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862998912 00000100:00100000:2.0:1787857114.402788:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:2.0:1787857114.402798:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:8126:x1874703862998912:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787857114.402815:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857114.402838:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827ae expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.402865:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.402877:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857114.402898:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ae00, rc 0) 00000100:00100000:2.0:1787857114.402993:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8126:x1874703862998912:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 195us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.403017:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:0.0:1787857114.404734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.404907:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999040 00000100:00100000:1.0:1787857114.404915:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999040 00000100:00100000:1.0:1787857114.404966:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:1.0:1787857114.404975:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8126:x1874703862999040:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787857114.405433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8126:x1874703862999040:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 455us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.405440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:3.0:1787857114.407140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.407238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999168 00000100:00100000:2.0:1787857114.407246:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999168 00000100:00100000:2.0:1787857114.407448:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:2.0:1787857114.407458:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8126:x1874703862999168:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787857114.407714:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8126:x1874703862999168:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 257us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.407722:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:0.0:1787857114.411638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.411975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999296 00000100:00100000:1.0:1787857114.411983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999296 00000100:00100000:1.0:1787857114.412034:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:1.0:1787857114.412043:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8134:x1874703862999296:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857114.412464:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8134:x1874703862999296:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 420us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.412473:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:0.0:1787857114.418916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.419751:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999424 00000100:00100000:2.0:1787857114.419762:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999424 00000100:00100000:2.0:1787857114.419878:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:2.0:1787857114.419899:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8134:x1874703862999424:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857114.420142:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:8134:x1874703862999424:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 255us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.420151:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:3.0:1787857114.424302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857114.424361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857114.424423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999552 00000100:00100000:3.0:1787857114.424439:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999552 00000100:00100000:3.0:1787857114.424484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999936 00000100:00100000:3.0:1787857114.424488:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999936 00000100:00100000:3.0:1787857114.424546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1787857114.424557:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862999936:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857114.424626:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703862999936:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857114.424634:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1787857114.424651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857114.424655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1874703862999552:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787857114.424707:0:5837:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 72d67940-6689-4986-afc2-7832ffa90fe3@192.168.204.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1787857114.424741:0:5837:0:(genops.c:1385:class_connect()) connect: client 72d67940-6689-4986-afc2-7832ffa90fe3, cookie 0xf326646fe3bbe874 00000004:00100000:3.0:1787857114.424781:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787857114.425088:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9fd9756d8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857114.425121:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2351:x1874703862999552:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 463us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857114.425127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00080000:3.0:1787857114.425148:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857114.431016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.431099:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999680 00000100:00100000:2.0:1787857114.431109:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999680 00000100:00100000:2.0:1787857114.431181:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857114.431201:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:0:x1874703862999680:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787857114.431243:0:8075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787857114.431342:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:0:x1874703862999680:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 151us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.431349:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00080000:3.0:1787857114.431850:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857114.433980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.434078:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703862999808 00000100:00100000:2.0:1787857114.434100:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703862999808 00000100:00100000:2.0:1787857114.434154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1787857114.434163:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703862999808:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787857114.434202:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787857114.434403:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703862999808:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 241us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857114.434412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1787857114.440751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857114.441790:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000064 00000100:00100000:0.0:1787857114.441808:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000064 00000100:00100000:0.0:1787857114.441911:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1787857114.441925:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703863000064:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787857114.442290:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703863000064:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 366us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857114.442301:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1787857114.446765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.446807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857114.446827:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857114.448052:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000448 00000100:00100000:1.0:1787857114.448064:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000448 00000100:00100000:1.0:1787857114.448133:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1787857114.448145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703863000448:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787857114.448456:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787857114.448617:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72d67940-6689-4986-afc2-7832ffa90fe3+6:8126:x1874703863000448:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 473us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.448625:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1787857114.454159:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000192 00000100:00100000:3.0:1787857114.454174:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000192 00000100:00100000:3.0:1787857114.454506:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000320 00000100:00100000:1.0:1787857114.454653:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1787857114.454682:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863000192:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787857114.454714:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 72d67940-6689-4986-afc2-7832ffa90fe3@192.168.204.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1787857114.454746:0:6678:0:(genops.c:1385:class_connect()) connect: client 72d67940-6689-4986-afc2-7832ffa90fe3, cookie 0xf326646fe3bbe87b 00002000:00100000:1.0:1787857114.454758:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 72d67940-6689-4986-afc2-7832ffa90fe3/ffff9fd97fb37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787857114.454784:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787857114.455033:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787857114.455066:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd97fb33800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857114.455221:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000320 00000100:00100000:3.0:1787857114.455267:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1787857114.455272:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1874703863000320:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787857114.455289:0:6676:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 72d67940-6689-4986-afc2-7832ffa90fe3@192.168.204.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1787857114.455307:0:6676:0:(genops.c:1385:class_connect()) connect: client 72d67940-6689-4986-afc2-7832ffa90fe3, cookie 0xf326646fe3bbe882 00002000:00100000:3.0:1787857114.455325:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72d67940-6689-4986-afc2-7832ffa90fe3/ffff9fd9756da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857114.455340:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857114.455488:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787857114.455504:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9fd9756dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857114.455552:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2351:x1874703863000192:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 870us (8743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857114.455560:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1787857114.462161:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72d67940-6689-4986-afc2-7832ffa90fe3+6:2351:x1874703863000320:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 6872us (15317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857114.462177:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00010000:00010000:2.0:1787857114.567974:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787857115.506888:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00010000:00010000:3.0:1787857115.592681:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857115.975826:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857115.975913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857115.976009:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051136 00000100:00100000:2.0:1787857115.976017:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051136 00000100:00100000:2.0:1787857115.976074:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787857115.976085:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885051136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857115.976119:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857115.976179:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885051136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857115.976186:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787857115.976358:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8ae940 x1874703885051136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857115.976380:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885051136:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787857115.976866:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857115.977141:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885051520:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.977187:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857115.977282:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857115.977289:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885051392:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.977319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857115.977394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051520 00000100:00100000:1.0:1787857115.977409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051520 00000100:00100000:1.0:1787857115.977463:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051392 00000100:00100000:1.0:1787857115.977467:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051392 00000100:00100000:1.0:1787857115.977490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857115.977498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857115.977561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885051520:12345-0@lo:400:kworker.0 Request processed in 64us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857115.977568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857115.977582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787857115.977589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885051392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857115.977616:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885051392:12345-0@lo:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857115.977622:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787857115.978052:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857115.978078:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885051392:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978089:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885051520:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978112:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885051648:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857115.978206:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857115.978213:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885051264:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857115.978266:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885051776:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857115.978321:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051264 00000100:00100000:3.0:1787857115.978325:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051264 00000100:00100000:3.0:1787857115.978353:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787857115.978359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885051264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978393:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885051264:12345-0@lo:400:kworker.0 Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857115.978400:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787857115.978434:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051776 00000100:00100000:3.0:1787857115.978438:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051776 00000100:00100000:3.0:1787857115.978469:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857115.978475:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885051776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978505:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885051776:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857115.978511:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787857115.978527:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857115.978555:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885051264:0@lo:400:kworker.0 00000100:00100000:3.0:1787857115.978565:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885051776:0@lo:400:kworker.0 00000100:00100000:1.0:1787857115.979923:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051648 00000100:00100000:1.0:1787857115.979932:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051648 00000100:00100000:1.0:1787857115.980042:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787857115.980050:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885051648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857115.980121:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885051648:12345-0@lo:400:kworker.0 Request processed in 72us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857115.980128:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787857115.980165:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6b0c0 x1874703885051648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857115.980178:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885051648:0@lo:400:kworker.0 00000100:00080000:3.0:1787857115.980221:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787857116.018697:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00010000:00010000:0.0:1787857116.617248:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857117.000610:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885051904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857117.000715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857117.000825:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885051904 00000100:00100000:3.0:1787857117.000843:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885051904 00000100:00100000:3.0:1787857117.000916:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857117.000925:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885051904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857117.000961:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857117.001013:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8aed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885051904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857117.001021:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787857117.001087:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb69680 x1874703885051904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857117.001107:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885051904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787857117.001332:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787857117.639830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857118.664736:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857119.553248:0:10303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787857119.597701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857119.597741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857119.597769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857119.597814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857119.597820:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001088 00000100:00100000:0.0:1787857119.597830:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001088 00000100:00100000:2.0:1787857119.597845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857119.597876:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000576 00000100:00100000:2.0:1787857119.597881:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000576 00000100:00100000:0.0:1787857119.597896:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000960 00000100:00100000:0.0:1787857119.597900:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000960 00000100:00100000:0.0:1787857119.597932:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1787857119.597945:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863001088:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857119.598022:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863001088:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857119.598031:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1787857119.598048:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1787857119.598054:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863000960:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857119.598077:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863000960:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857119.598083:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00080000:0.0:1787857119.598098:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857119.598102:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857119.599592:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:2.0:1787857119.599622:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863000576:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857119.599702:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863000576:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 91us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857119.599711:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:2.0:1787857119.599765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000832 00000100:00100000:2.0:1787857119.599771:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000832 00000100:00100000:2.0:1787857119.599838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863000704 00000100:00100000:2.0:1787857119.599842:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863000704 00000100:00100000:2.0:1787857119.599873:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1787857119.599881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863000832:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857119.599915:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863000832:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (2173us total) trans 0 rc 0/0 00000100:00080000:0.0:1787857119.599922:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857119.599923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:3.0:1787857119.601735:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1787857119.601755:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863000704:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857119.601848:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863000704:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857119.601857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000001:00100000:1.0:1787857119.636073:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00010000:00010000:2.0:1787857119.689171:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857120.711849:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857121.095955:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885052032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857121.096350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857121.097576:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885052160:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.097628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857121.098546:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885052672:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.098585:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857121.098617:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857121.098624:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885052288:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.098644:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857121.098645:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052672 00000100:00100000:1.0:1787857121.098673:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052672 00000100:00100000:3.0:1787857121.098687:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885052416:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.098710:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857121.098728:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857121.098734:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885052544:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.098768:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857121.098798:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052160 00000100:00100000:3.0:1787857121.098802:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052160 00000100:00100000:3.0:1787857121.098831:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787857121.098840:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885052160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857121.098887:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052288 00000100:00100000:1.0:1787857121.098892:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052288 00000100:00100000:1.0:1787857121.098914:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052416 00000100:00100000:1.0:1787857121.098917:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052416 00000100:00100000:1.0:1787857121.098931:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787857121.098937:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857121.100076:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787857121.100092:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885052288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857121.102036:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885052672:12345-0@lo:400:kworker.0 Request processed in 3090us (3441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857121.102048:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787857121.102205:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787857121.102227:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885052416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857121.102285:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885052416:12345-0@lo:400:kworker.0 Request processed in 73us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857121.102291:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787857121.103088:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052032 00000100:00100000:0.0:1787857121.103101:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052032 00000100:00100000:0.0:1787857121.103161:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787857121.103171:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885052032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857121.103208:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857121.103261:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885052032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (6912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857121.103267:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787857121.103300:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857121.103305:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787857121.103334:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6c000 x1874703885052032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857121.103354:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885052032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857121.103428:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052544 00000100:00100000:0.0:1787857121.103433:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052544 00000100:00100000:0.0:1787857121.103475:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787857121.103483:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885052544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857121.103519:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885052544:12345-0@lo:400:kworker.0 Request processed in 37us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857121.103526:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787857121.103546:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857121.103979:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885052288:12345-0@lo:400:kworker.0 Request processed in 3891us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857121.103996:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787857121.104059:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885052288:0@lo:400:kworker.0 00000100:00100000:2.0:1787857121.104074:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885052672:0@lo:400:kworker.0 00010000:00080000:2.0:1787857121.104110:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb68780 x1874703885052544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857121.104121:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885052544:0@lo:400:kworker.0 00000100:00100000:2.0:1787857121.104131:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885052416:0@lo:400:kworker.0 00000100:00100000:3.0:1787857121.104585:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885052160:12345-0@lo:400:kworker.0 Request processed in 5743us (6953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857121.104594:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787857121.104641:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885052160:0@lo:400:kworker.0 00010000:00010000:3.0:1787857121.737988:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857122.133532:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857122.133558:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885052800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857122.133636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857122.134053:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052800 00000100:00100000:1.0:1787857122.134063:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052800 00000100:00100000:1.0:1787857122.134128:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787857122.134138:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a407c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885052800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857122.134463:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857122.134533:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a407c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885052800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 396us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857122.134542:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787857122.134718:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6f480 x1874703885052800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857122.134750:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885052800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857122.762431:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857123.784008:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857124.705023:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857124.705076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857124.705099:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857124.705124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857124.705152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857124.705186:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001728 00000100:00100000:0.0:1787857124.705194:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001728 00000100:00100000:0.0:1787857124.705254:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001600 00000100:00100000:0.0:1787857124.705257:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001600 00000100:00100000:0.0:1787857124.705283:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1787857124.705292:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001728:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857124.705368:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001728:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857124.705376:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1787857124.705394:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1787857124.705401:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001600:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857124.705428:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001600:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857124.705455:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1787857124.705479:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001472 00000100:00100000:0.0:1787857124.705482:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001472 00000100:00100000:0.0:1787857124.705509:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001344 00000100:00100000:0.0:1787857124.705513:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001344 00000100:00100000:0.0:1787857124.705534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:0.0:1787857124.705541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001472:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857124.705571:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863001472:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857124.705577:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:0.0:1787857124.705589:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:0.0:1787857124.705596:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703863001344:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857124.705620:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703863001344:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857124.705627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00080000:0.0:1787857124.705648:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857124.705655:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857124.705703:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857124.706480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001216 00000100:00100000:3.0:1787857124.706487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001216 00000100:00100000:3.0:1787857124.722202:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:3.0:1787857124.722223:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863001216:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857124.722308:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863001216:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (17311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857124.722315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 220 00010000:00010000:2.0:1787857124.809474:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857125.834830:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857126.216006:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885053056:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216024:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885052928:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857126.216136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885052928 00000100:00100000:3.0:1787857126.216144:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885052928 00000100:00100000:2.0:1787857126.216162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885053440:0@lo:400:kworker.0 00000100:00100000:3.0:1787857126.216195:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787857126.216196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857126.216226:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857126.216232:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885053568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857126.216287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857126.216302:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885053184:0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216331:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053440 00000100:00100000:2.0:1787857126.216336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857126.216337:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053440 00000100:00100000:2.0:1787857126.216362:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857126.216370:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885053312:0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053056 00000100:00100000:0.0:1787857126.216385:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053056 00000100:00100000:2.0:1787857126.216398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857126.216406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053184 00000100:00100000:0.0:1787857126.216410:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053184 00000100:00100000:0.0:1787857126.216431:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787857126.216448:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787857126.216462:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216529:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885053440:12345-0@lo:400:kworker.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857126.216537:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885053056:12345-0@lo:400:kworker.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857126.216541:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787857126.216551:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787857126.216566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787857126.216575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885053184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216600:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053568 00000100:00100000:2.0:1787857126.216605:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053568 00000100:00100000:0.0:1787857126.216613:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885053184:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857126.216631:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053312 00000100:00100000:0.0:1787857126.216633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787857126.216634:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053312 00000100:00080000:0.0:1787857126.216684:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787857126.216690:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857126.216693:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857126.216705:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787857126.216715:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216720:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787857126.216731:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885053312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216769:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885053568:12345-0@lo:400:kworker.0 Request processed in 56us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857126.216775:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885053312:12345-0@lo:400:kworker.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857126.216783:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787857126.216831:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2da40 x1874703885053312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857126.216845:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885053312:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216857:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885053184:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216890:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885053056:0@lo:400:kworker.0 00010000:00080000:2.0:1787857126.216909:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2ed00 x1874703885053568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857126.216925:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885053568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857126.216937:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885053440:0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.216996:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787857126.217057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885052928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857126.217111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885052928:12345-0@lo:400:kworker.0 Request processed in 905us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857126.217118:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787857126.218606:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857126.218635:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885053696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857126.218708:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857126.218769:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885052928:0@lo:400:kworker.0 00000100:00100000:0.0:1787857126.218884:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053696 00000100:00100000:0.0:1787857126.218891:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053696 00000100:00100000:0.0:1787857126.218936:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857126.218945:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885053696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857126.218978:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857126.219020:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885053696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857126.219026:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787857126.219312:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6ed00 x1874703885053696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857126.219330:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885053696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857126.859027:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857127.239887:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857127.239919:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885053824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857127.240013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857127.240089:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053824 00000100:00100000:1.0:1787857127.240097:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053824 00000100:00100000:1.0:1787857127.240158:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787857127.240168:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885053824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857127.240207:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857127.240255:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885053824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857127.240262:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787857127.240305:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6ed00 x1874703885053824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857127.240325:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885053824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857127.887343:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857128.905017:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857129.828209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857129.828251:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857129.828291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857129.828314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857129.828352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857129.828382:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001856 00000100:00100000:1.0:1787857129.828392:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001856 00000100:00100000:1.0:1787857129.828449:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:1.0:1787857129.828460:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863001856:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857129.828535:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863001856:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 77us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857129.828542:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:1.0:1787857129.828598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863001984 00000100:00100000:1.0:1787857129.828602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863001984 00000100:00100000:1.0:1787857129.828639:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002112 00000100:00100000:1.0:1787857129.828642:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002112 00000100:00100000:1.0:1787857129.828688:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1787857129.828696:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703863001984:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857129.828727:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703863001984:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857129.828733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1787857129.828747:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:1.0:1787857129.828753:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857129.828776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857129.828782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:1.0:1787857129.828801:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002240 00000100:00100000:1.0:1787857129.828804:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002240 00000100:00100000:1.0:1787857129.828828:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002368 00000100:00100000:1.0:1787857129.828831:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002368 00000100:00100000:1.0:1787857129.828850:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:1.0:1787857129.828856:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857129.828881:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857129.828888:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:1.0:1787857129.828913:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:1.0:1787857129.828920:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857129.828944:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863002368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857129.831094:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00080000:1.0:1787857129.831294:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857129.831301:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857129.831304:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787857129.927915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857130.961480:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857131.337644:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885053952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857131.337730:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.337788:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885054464:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.337812:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.337835:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787857131.337840:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885054080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.337865:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.337888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885054592:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.337911:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.337939:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885054208:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.337961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.337978:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885054720:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.338030:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857131.338034:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885054336:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338054:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857131.338084:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885053952 00000100:00100000:2.0:1787857131.338092:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885053952 00000100:00100000:2.0:1787857131.338144:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787857131.338152:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885053952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857131.338185:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857131.338224:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885053952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338231:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787857131.338251:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054464 00000100:00100000:2.0:1787857131.338253:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054464 00000100:00100000:2.0:1787857131.338274:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054720 00000100:00100000:2.0:1787857131.338277:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054720 00000100:00100000:2.0:1787857131.338294:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787857131.338300:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338330:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885054464:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338336:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787857131.338360:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787857131.338367:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885054720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338398:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885054720:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338403:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787857131.338420:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054080 00000100:00100000:2.0:1787857131.338429:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054080 00000100:00100000:2.0:1787857131.338456:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787857131.338462:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885054080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338489:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885054080:12345-0@lo:400:kworker.0 Request processed in 29us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787857131.338519:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054592 00000100:00100000:2.0:1787857131.338523:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054592 00000100:00100000:2.0:1787857131.338549:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054208 00000100:00100000:2.0:1787857131.338552:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054208 00000100:00100000:2.0:1787857131.338579:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054336 00000100:00100000:2.0:1787857131.338582:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054336 00000100:00100000:2.0:1787857131.338597:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857131.338602:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338632:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885054592:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338637:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857131.338647:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787857131.338683:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885054208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338711:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885054208:12345-0@lo:400:kworker.0 Request processed in 58us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338717:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787857131.338728:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787857131.338734:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338756:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885054336:12345-0@lo:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857131.338760:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787857131.338793:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857131.338798:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857131.338799:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857131.338841:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885054336:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338850:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885054208:0@lo:400:kworker.0 00010000:00080000:2.0:1787857131.338860:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2d680 x1874703885054720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857131.338869:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885054720:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338896:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885054080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857131.338905:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885054592:0@lo:400:kworker.0 00010000:00080000:2.0:1787857131.338913:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2c3c0 x1874703885053952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857131.338926:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885053952:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787857131.338935:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2e1c0 x1874703885054464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857131.338943:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885054464:0@lo:400:kworker.0 00010000:00010000:2.0:1787857131.977206:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857132.361828:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885054848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857132.362261:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857132.365093:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054848 00000100:00100000:1.0:1787857132.365108:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054848 00000100:00100000:1.0:1787857132.365434:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787857132.365444:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885054848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857132.365484:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857132.365588:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885054848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857132.365596:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787857132.368952:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb68b40 x1874703885054848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857132.368979:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885054848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857133.003794:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857134.024807:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857134.946769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857134.946825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857134.946854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857134.946896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857134.946931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857134.946960:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002880 00000100:00100000:1.0:1787857134.946969:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002880 00000100:00100000:1.0:1787857134.947025:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003008 00000100:00100000:1.0:1787857134.947029:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003008 00000100:00100000:1.0:1787857134.947054:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1787857134.947064:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2351:x1874703863002880:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1787857134.947095:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe87b 00000100:00080000:1.0:1787857134.947105:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9fd97fb33800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787857134.947148:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787857134.947171:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002752 00000100:00100000:2.0:1787857134.947186:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002752 00000100:00100000:2.0:1787857134.947258:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002624 00000100:00100000:2.0:1787857134.947263:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002624 00000100:00100000:2.0:1787857134.947299:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:2.0:1787857134.947310:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863002752:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857134.947417:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863002752:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 108us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857134.947441:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:2.0:1787857134.947471:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1787857134.947481:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863002624:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857134.947528:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863002624:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857134.947534:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:1.0:1787857134.947766:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72d67940-6689-4986-afc2-7832ffa90fe3+2:2351:x1874703863002880:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 699us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857134.947777:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:0.0:1787857134.947864:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857134.947898:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1787857134.947912:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72d67940-6689-4986-afc2-7832ffa90fe3+5:2351:x1874703863003008:12345-192.168.204.29@tcp:9:kworker.0 00000100:00080000:2.0:1787857134.948134:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857134.948140:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857134.948143:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857134.948228:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863002496 00000100:00100000:3.0:1787857134.948236:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863002496 00000100:00100000:3.0:1787857134.948295:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:3.0:1787857134.948304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863002496:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857134.948335:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863002496:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857134.948341:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 224 00000020:00000080:0.0:1787857134.951155:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe882 00000100:00080000:0.0:1787857134.951186:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd9756dc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857134.951265:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787857134.955975:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b64f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72d67940-6689-4986-afc2-7832ffa90fe3+2:2351:x1874703863003008:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 8051us (9026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857134.956000:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00010000:00010000:3.0:1787857134.962012:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857135.049203:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857136.073614:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857136.164386:0:11003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787857136.456690:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885054976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.456784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.456856:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885055488:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.456889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.456924:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787857136.456933:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885055104:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.456967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.456995:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885055616:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457030:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.457080:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885055232:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.457140:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857136.457175:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.457212:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857136.457236:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055360:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857136.457336:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885054976 00000100:00100000:2.0:1787857136.457345:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885054976 00000100:00100000:2.0:1787857136.457422:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787857136.457439:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457532:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885054976:12345-0@lo:400:kworker.0 Request processed in 97us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.457542:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787857136.457592:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055488 00000100:00100000:2.0:1787857136.457596:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055488 00000100:00100000:2.0:1787857136.457635:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055104 00000100:00100000:2.0:1787857136.457639:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055104 00000100:00100000:2.0:1787857136.457683:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055232 00000100:00100000:2.0:1787857136.457686:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055232 00000100:00100000:2.0:1787857136.457704:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787857136.457711:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457745:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885055488:12345-0@lo:400:kworker.0 Request processed in 34us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.457753:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787857136.457775:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787857136.457786:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885055104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457826:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885055104:12345-0@lo:400:kworker.0 Request processed in 44us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.457837:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787857136.457865:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787857136.457877:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885055232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.457940:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885055232:12345-0@lo:400:kworker.0 Request processed in 65us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.457949:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787857136.457990:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055616 00000100:00100000:2.0:1787857136.457994:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055616 00000100:00100000:2.0:1787857136.458043:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055360 00000100:00100000:2.0:1787857136.458048:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055360 00000100:00100000:2.0:1787857136.458103:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857136.458115:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885055616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.458168:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885055616:12345-0@lo:400:kworker.0 Request processed in 59us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.458178:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857136.458209:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787857136.458223:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.458278:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055360:12345-0@lo:400:kworker.0 Request processed in 59us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.458287:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787857136.458335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055744 00000100:00100000:2.0:1787857136.458340:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055744 00000100:00100000:2.0:1787857136.458391:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787857136.458405:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857136.458450:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857136.458501:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857136.458508:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787857136.458538:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857136.458543:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857136.458553:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787857136.458798:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2c780 x1874703885055360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857136.458817:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055360:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.458832:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885055232:0@lo:400:kworker.0 00010000:00080000:2.0:1787857136.458844:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97fb6ed00 x1874703885055744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857136.458860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857136.458906:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885055104:0@lo:400:kworker.0 00010000:00080000:2.0:1787857136.458915:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2de00 x1874703885055616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857136.458924:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885055616:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.458935:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885054976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857136.458947:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885055488:0@lo:400:kworker.0 00000001:00100000:3.0:1787857136.588959:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00000020:00000080:3.0:1787857136.588969:0:6702:0:(genops.c:885:class_export_put()) final put ffff9fd97fb37000/72d67940-6689-4986-afc2-7832ffa90fe3 00000020:00000080:2.0:1787857136.589049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fb37000/72d67940-6689-4986-afc2-7832ffa90fe3 for lustre-OST0000 00000020:00000080:2.0:1787857136.589104:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd97fb33800 for lustre-OST0000 00010000:00010000:3.0:1787857137.096497:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857137.487154:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857137.487193:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857137.487271:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857137.487452:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885055872 00000100:00100000:0.0:1787857137.487460:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885055872 00000100:00100000:0.0:1787857137.487643:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787857137.487680:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857137.487719:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857137.487795:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885055872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (524us total) trans 0 rc 0/0 00010000:00080000:1.0:1787857137.493914:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9759d1a40 x1874703885055872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857137.493944:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885055872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857137.496901:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1787857138.120186:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857139.145330:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857140.069363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857140.069405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857140.069433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857140.069463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003136 00000100:00100000:3.0:1787857140.069472:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003136 00000100:00100000:3.0:1787857140.069524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:3.0:1787857140.069535:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863003136:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857140.069600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863003136:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857140.069608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:3.0:1787857140.069641:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003392 00000100:00100000:3.0:1787857140.069644:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003392 00000100:00100000:3.0:1787857140.069721:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003264 00000100:00100000:3.0:1787857140.069725:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003264 00000100:00100000:3.0:1787857140.069747:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1787857140.069762:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863003392:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857140.069793:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863003392:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857140.069799:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1787857140.069812:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:3.0:1787857140.069818:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863003264:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857140.069841:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863003264:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857140.069847:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00080000:3.0:1787857140.069971:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787857140.084951:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00000020:00000080:3.0:1787857140.084961:0:7626:0:(genops.c:885:class_export_put()) final put ffff9fd9756da000/72d67940-6689-4986-afc2-7832ffa90fe3 00000020:00000080:3.0:1787857140.084989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9756da000/72d67940-6689-4986-afc2-7832ffa90fe3 for lustre-OST0001 00000020:00000080:3.0:1787857140.085045:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9756dc800 for lustre-OST0001 00010000:00010000:3.0:1787857140.169893:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787857140.252273:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd775aa8f0 20000000:00000080:0.0:1787857140.252292:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd94811ac00 uarg=0000000000000000 20000000:01000000:0.0:1787857140.252330:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787857140.252337:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787857140.252341:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787857140.255083:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787857140.255325:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787857140.263334:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787857140.263484:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263505:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263513:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263520:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263529:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263550:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263557:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263603:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263619:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 12 pid: 5829 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.263633:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056000:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857140.263778:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263787:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 12 pid: 5831 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.263796:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056128:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857140.263826:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263834:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.263844:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056256:0@lo:104: 00000100:00100000:3.0:1787857140.263878:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857140.263918:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263927:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 18 pid: 5830 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.263935:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056384:0@lo:104: 00000100:00100000:3.0:1787857140.263954:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787857140.263976:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.263984:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 18 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.263992:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056512:0@lo:104: 00000100:00100000:3.0:1787857140.264022:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857140.264034:0:11153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddcea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857140.264627:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056256 00000100:00100000:0.0:1787857140.264635:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056256 00000100:00100000:0.0:1787857140.264703:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056384 00000100:00100000:0.0:1787857140.264707:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056384 00000100:00100000:0.0:1787857140.264721:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056512 00000100:00100000:0.0:1787857140.264733:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056512 00000100:00100000:0.0:1787857140.264753:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857140.264761:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:11153:x1874703885056256:12345-0@lo:104: 00010000:00010000:0.0:1787857140.264775:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.264834:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857140.264840:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:11153:x1874703885056256:12345-0@lo:104: Request processed in 81us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857140.264847:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857140.264865:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857140.264871:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:11153:x1874703885056384:12345-0@lo:104: 00010000:00010000:0.0:1787857140.264878:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.264916:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787857140.264921:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:11153:x1874703885056384:12345-0@lo:104: Request processed in 52us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857140.264927:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857140.264939:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857140.264945:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:11153:x1874703885056512:12345-0@lo:104: 00010000:00010000:0.0:1787857140.264952:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.264982:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787857140.264988:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:11153:x1874703885056512:12345-0@lo:104: Request processed in 43us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857140.264994:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787857140.265017:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787857140.265024:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.265033:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857140.265038:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.265047:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857140.265054:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857140.265060:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787857140.265094:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.265100:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857140.265343:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857140.265348:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.265355:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857140.265357:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.265364:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857140.265369:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857140.265399:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787857140.265415:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.265421:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857140.265473:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857140.265517:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.265526:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489400/0xf326646fe3bbe84a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe851 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857140.265540:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857140.265543:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857140.265544:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857140.265795:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.265804:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbe83c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe843 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.265814:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857140.265816:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857140.265818:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857140.265833:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885056768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857140.265879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857140.265918:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857140.265925:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885056640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857140.265948:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857140.266010:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056256:0@lo:104: 00000100:00100000:3.0:1787857140.266021:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056384:0@lo:104: 00000100:00100000:3.0:1787857140.266029:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056512:0@lo:104: 00000100:00100000:1.0:1787857140.266259:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056768 00000100:00100000:1.0:1787857140.266264:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056768 00010000:00010000:1.0:1787857140.266291:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 19 pid: 5830 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857140.266319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056640 00000100:00100000:1.0:1787857140.266322:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056640 00010000:00010000:1.0:1787857140.266333:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 20 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857140.266346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787857140.266353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3312:x1874703885056768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857140.266365:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857140.266370:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 20 pid: 5830 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266405:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 20 pid: 5830 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266421:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341aa00/0xf326646fe3bbe843 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe83c expref: 20 pid: 5830 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266434:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857140.266472:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885056768:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857140.266479:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787857140.266523:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787857140.266529:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3312:x1874703885056640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857140.266537:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857140.266541:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266550:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266561:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975560a00/0xf326646fe3bbe851 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe84a expref: 18 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857140.266569:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857140.266593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3312:x1874703885056640:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857140.266599:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857140.266870:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885056640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857140.266881:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885056768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857140.267703:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857140.267706:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857140.267715:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857140.267837:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.267848:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857140.267852:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.267869:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857140.267876:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857140.267883:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857140.267928:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.267935:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857140.267961:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.267969:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd975560c00/0xf326646fe3bbe82e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.267987:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857140.267988:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857140.267990:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857140.267997:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857140.268010:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885056896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857140.268059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857140.268111:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885056896 00000100:00100000:2.0:1787857140.268267:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885056896 00010000:00010000:2.0:1787857140.268294:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857140.268326:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787857140.268334:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3310:x1874703885056896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857140.268353:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857140.268359:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.268369:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.268394:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ac00/0xf326646fe3bbe835 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe82e expref: 17 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.268405:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857140.268447:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3310:x1874703885056896:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857140.268454:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787857140.269334:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885056896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857140.278789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857140.278852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857140.279038:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003520 00000100:00100000:2.0:1787857140.279048:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003520 00010000:00010000:2.0:1787857140.279093:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 13 pid: 5829 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857140.279138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003648 00000100:00100000:2.0:1787857140.279141:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003648 00010000:00010000:2.0:1787857140.279154:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 14 pid: 5831 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857140.279180:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:2.0:1787857140.279191:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+14:2352:x1874703863003520:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857140.279205:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857140.279211:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 14 pid: 5829 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279241:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 14 pid: 5829 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279262:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857140.279321:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+14:2352:x1874703863003520:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 132us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857140.279329:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:2.0:1787857140.279346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:2.0:1787857140.279353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863003648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857140.279362:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857140.279367:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 13 pid: 5831 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279376:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 13 pid: 5831 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279401:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279411:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279428:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279436:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279443:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279456:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279463:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857140.279467:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279476:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279486:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857140.279496:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857140.279517:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863003648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 164us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857140.279524:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00010000:00010000:3.0:1787857140.280038:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe86d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ae expref: 12 pid: 5829 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.280060:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056000:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857140.280915:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe858 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882776 expref: 11 pid: 5831 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857140.280928:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874703885056128:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857140.280961:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.280969:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.280975:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857140.280982:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe889 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857141.192037:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857141.287434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857141.287536:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003776 00000100:00100000:2.0:1787857141.287546:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003776 00000100:00100000:2.0:1787857141.287603:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 227 00000100:00100000:2.0:1787857141.287613:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:5594:x1874703863003776:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857141.287629:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857141.287650:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.287738:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.287778:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.287786:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341b400, rc 0) 00000100:00100000:2.0:1787857141.287837:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863003776:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 225us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.287843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 227 00000100:00100000:3.0:1787857141.304078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857141.304836:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863003904 00000100:00100000:2.0:1787857141.304846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863003904 00000100:00100000:2.0:1787857141.305316:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:2.0:1787857141.305329:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863003904:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857141.307150:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863003904:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 1816us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.307163:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:0.0:1787857141.310002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857141.310239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004032 00000100:00100000:3.0:1787857141.310248:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004032 00000100:00100000:3.0:1787857141.310301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:3.0:1787857141.310309:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863004032:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857141.311351:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863004032:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 1035us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.311373:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:1.0:1787857141.323847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857141.324247:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004160 00000100:00100000:2.0:1787857141.324258:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004160 00000100:00100000:2.0:1787857141.324320:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00100000:2.0:1787857141.324330:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863004160:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857141.324345:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857141.324383:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827df expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.324412:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.324424:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857141.324449:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ae00, rc 0) 00000100:00100000:2.0:1787857141.324531:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863004160:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 202us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.324538:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00100000:0.0:1787857141.326393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857141.326515:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004288 00000100:00100000:3.0:1787857141.326531:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004288 00000100:00100000:3.0:1787857141.326581:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 231 00000100:00100000:3.0:1787857141.326590:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863004288:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857141.327394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863004288:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 803us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.327404:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 231 00000100:00100000:0.0:1787857141.331418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857141.331505:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004416 00000100:00100000:3.0:1787857141.331514:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004416 00000100:00100000:3.0:1787857141.331569:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 232 00000100:00100000:3.0:1787857141.331579:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863004416:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857141.332338:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863004416:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 758us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.332347:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 232 00000100:00100000:2.0:1787857141.577437:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885057152:0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.577508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857141.577579:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885057664:0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.577621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857141.577655:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857141.577688:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885057280:0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.577713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857141.577782:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057152 00000100:00100000:2.0:1787857141.577790:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057152 00000100:00100000:2.0:1787857141.577851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057280 00000100:00100000:2.0:1787857141.577854:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057280 00000100:00100000:2.0:1787857141.577913:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787857141.577922:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885057152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.577974:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885057152:12345-0@lo:400:kworker.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.577981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787857141.577999:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787857141.578005:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885057280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.578032:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885057280:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.578037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787857141.578066:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057664 00000100:00100000:2.0:1787857141.578069:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057664 00000100:00100000:2.0:1787857141.578095:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787857141.578101:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885057664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.578131:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885057664:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857141.578136:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787857141.578173:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885057280:0@lo:400:kworker.0 00000100:00100000:2.0:1787857141.578202:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885057152:0@lo:400:kworker.0 00010000:00080000:2.0:1787857141.578227:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4043c0 x1874703885057664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857141.578239:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885057664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.580478:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885057408:0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.580542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857141.580578:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857141.580585:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885057024:0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.580611:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857141.580638:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885057536:0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.580686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857141.580715:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885057792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857141.580752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857141.580784:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057536 00000100:00100000:3.0:1787857141.580791:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057536 00000100:00100000:3.0:1787857141.580839:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787857141.580855:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885057536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.580901:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885057536:12345-0@lo:400:kworker.0 Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.580908:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787857141.580933:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857141.580939:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857141.580955:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057408 00000100:00100000:3.0:1787857141.580959:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057408 00000100:00100000:3.0:1787857141.580988:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787857141.580995:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885057408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.581026:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885057408:12345-0@lo:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.581032:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787857141.581048:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057024 00000100:00100000:3.0:1787857141.581052:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057024 00000100:00100000:3.0:1787857141.581076:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787857141.581082:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3309:x1874703885057024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.581109:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3309:x1874703885057024:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.581116:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787857141.581146:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057792 00000100:00100000:3.0:1787857141.581150:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057792 00000100:00100000:3.0:1787857141.581246:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787857141.581278:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885057792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857141.581368:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857141.581423:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a46d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885057792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857141.581452:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787857141.581495:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787857141.581520:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd975a44b40 x1874703885057792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857141.581538:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885057792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857141.581566:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885057024:0@lo:400:kworker.0 00000100:00100000:3.0:1787857141.581578:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885057536:0@lo:400:kworker.0 00010000:00080000:3.0:1787857141.581587:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd945c2cf00 x1874703885057408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857141.581596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885057408:0@lo:400:kworker.0 10000000:01000000:1.0:1787857142.216729:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857142.216736:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd975d01000 from 7 10000000:01000000:1.0:1787857142.216740:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857142.216784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.216806:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.216817:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857142.216844:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885057920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.216925:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.216972:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.217250:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885057920 00000100:00100000:3.0:1787857142.217258:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885057920 00000100:00100000:3.0:1787857142.217315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787857142.217326:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885057920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857142.217340:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857142.217363:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe89e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.217385:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.217395:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.217404:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d600, rc 0) 00000100:00100000:3.0:1787857142.217458:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885057920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.217465:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787857142.217511:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885057920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857142.217525:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.217535:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857142.217594:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.217623:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857142.217644:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddcecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.217656:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058048 00000100:00100000:3.0:1787857142.217680:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058048 00000100:00100000:3.0:1787857142.217704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787857142.217711:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885058048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.218154:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885058048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 442us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.218162:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787857142.218228:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857142.218263:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857142.218303:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857142.218333:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cde40 going to sleep for 11 seconds 00010000:00010000:1.0:1787857142.218394:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857142.218426:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058176 00000100:00100000:3.0:1787857142.218431:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058176 00000100:00100000:3.0:1787857142.218460:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787857142.218467:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885058176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.218612:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885058176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.218619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787857142.218727:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787857142.219733:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787857142.222882:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787857142.222981:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857142.222995:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.223009:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857142.223039:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857142.223042:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd950737800 from 7 10000000:01000000:1.0:1787857142.223044:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857142.223082:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.223090:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.223102:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857142.223130:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.223206:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.223298:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.228000:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058304 00000100:00100000:3.0:1787857142.228014:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058304 00000100:00100000:3.0:1787857142.228081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787857142.228092:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885058304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857142.228109:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857142.228128:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe8ac expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.228156:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.228167:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.228177:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216cc00, rc 0) 00000100:00100000:3.0:1787857142.228250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.228257:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787857142.228310:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857142.228327:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.228336:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857142.228411:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.228440:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857142.228468:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddce780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.228493:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058432 00000100:00100000:3.0:1787857142.228497:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058432 00000100:00100000:3.0:1787857142.228522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787857142.228527:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.229385:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 852us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.229393:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787857142.229434:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.229470:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.229512:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857142.229576:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddce780 going to sleep for 11 seconds 00000100:00100000:1.0:1787857142.233397:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058560 00000100:00100000:1.0:1787857142.233415:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058560 00000100:00100000:1.0:1787857142.233488:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787857142.233498:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.233786:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 289us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857142.233987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787857142.234060:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787857142.234991:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787857142.235764:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787857142.235788:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857142.235961:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.235988:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857142.236000:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857142.236003:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96116a000 from 7 10000000:01000000:1.0:1787857142.236006:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857142.236041:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.236048:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.236058:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857142.236082:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.236142:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.236185:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.236232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058688 00000100:00100000:3.0:1787857142.236239:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058688 00000100:00100000:3.0:1787857142.236286:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787857142.236295:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885058688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857142.236306:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857142.236319:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe8ba expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.236341:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.236362:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857142.236371:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216ca00, rc 0) 00000100:00100000:3.0:1787857142.236408:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885058688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.236422:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787857142.236500:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857142.236514:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.236524:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857142.236569:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.236595:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.236625:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857142.237187:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058816 00000100:00100000:3.0:1787857142.237193:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058816 00000100:00100000:3.0:1787857142.237230:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787857142.237238:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885058816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857142.237498:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885058816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857142.237505:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787857142.238071:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.238110:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857142.238156:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.238188:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857142.238252:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885058944 00000100:00100000:0.0:1787857142.238257:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885058944 00000100:00100000:0.0:1787857142.238292:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787857142.238300:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885058944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857142.238462:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885058944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857142.238469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787857142.238966:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885058944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787857142.239623:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787857142.239701:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787857142.239716:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857142.239727:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857142.239738:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857142.602174:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857142.602572:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885059072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857142.602641:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857142.603478:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059072 00000100:00100000:1.0:1787857142.603489:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059072 00000100:00100000:1.0:1787857142.603554:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787857142.603565:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885059072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857142.603604:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857142.603766:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885059072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857142.603773:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787857142.604249:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9759d0f00 x1874703885059072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857142.604269:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885059072:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857143.246157:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857144.275901:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787857144.813896:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787857145.186839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857145.186947:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857145.187076:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004544 00000100:00100000:0.0:1787857145.187087:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004544 00000100:00100000:1.0:1787857145.187090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857145.187156:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 243 00000100:00100000:0.0:1787857145.187168:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863004544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857145.187261:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863004544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857145.187269:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 243 00000100:00100000:3.0:1787857145.191251:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004672 00000100:00100000:2.0:1787857145.191261:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004800 00000100:00100000:3.0:1787857145.191267:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004672 00000100:00100000:2.0:1787857145.191269:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004800 00000100:00100000:3.0:1787857145.191525:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:2.0:1787857145.191536:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:3.0:1787857145.191542:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703863004672:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857145.191552:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2355:x1874703863004800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857145.191630:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2355:x1874703863004800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 82us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857145.191639:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00080000:0.0:1787857145.198893:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857145.199059:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703863004672:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 7515us (12102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857145.199072:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00010000:00010000:0.0:1787857145.287863:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857146.319582:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857146.695899:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857146.695922:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857146.697521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857146.698082:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885059328:0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.698133:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857146.698528:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885059456:0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.698562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857146.698608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059328 00000100:00100000:0.0:1787857146.698614:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059328 00000100:00100000:0.0:1787857146.698657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787857146.698693:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885059328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857146.698713:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885059584:0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.698741:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885059328:12345-0@lo:400:kworker.0 Request processed in 51us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857146.698749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787857146.698758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857146.698784:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857146.698788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059456 00000100:00100000:1.0:1787857146.698792:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885059712:0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.698794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059456 00000100:00100000:1.0:1787857146.698822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857146.698853:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059200 00000100:00100000:1.0:1787857146.698857:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059200 00000100:00100000:1.0:1787857146.698894:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787857146.698902:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885059200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857146.698928:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857146.698960:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885059200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857146.698966:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787857146.698983:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059584 00000100:00100000:1.0:1787857146.698986:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059584 00000100:00100000:1.0:1787857146.699009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787857146.699027:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885059584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857146.699054:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885059584:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857146.699059:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787857146.699090:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885059584:0@lo:400:kworker.0 00010000:00080000:1.0:1787857146.699118:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd975a44780 x1874703885059200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857146.699133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857146.699332:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885059328:0@lo:400:kworker.0 00000100:00100000:1.0:1787857146.699339:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885059840:0@lo:400:kworker.0 00000100:00100000:1.0:1787857146.699361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857146.699385:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059840 00000100:00100000:0.0:1787857146.699391:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059840 00000100:00080000:1.0:1787857146.699406:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857146.699411:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857146.699422:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787857146.699430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885059456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.699470:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885059456:12345-0@lo:400:kworker.0 Request processed in 41us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857146.699476:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787857146.699488:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787857146.699502:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885059840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.699537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885059840:12345-0@lo:400:kworker.0 Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857146.699543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787857146.699567:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885059456:0@lo:400:kworker.0 00000100:00100000:0.0:1787857146.700744:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885059840:0@lo:400:kworker.0 00000100:00100000:2.0:1787857146.700851:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059712 00000100:00100000:2.0:1787857146.700857:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059712 00000100:00100000:2.0:1787857146.700896:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857146.700904:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885059712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857146.700960:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885059712:12345-0@lo:400:kworker.0 Request processed in 57us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857146.700974:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787857146.700997:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787857146.701015:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97b71c3c0 x1874703885059712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857146.701025:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885059712:0@lo:400:kworker.0 00010000:00010000:3.0:1787857147.338645:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857147.721926:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857147.721948:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885059968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857147.722055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857147.722121:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885059968 00000100:00100000:1.0:1787857147.722128:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885059968 00000100:00100000:1.0:1787857147.722174:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787857147.722184:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885059968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857147.722258:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857147.722302:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885059968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857147.722310:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787857147.722352:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9759d0f00 x1874703885059968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857147.722370:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885059968:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787857147.818140:0:11451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:59:05 (1787857145) === 00010000:00010000:1.0:1787857148.364967:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857148.371770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.371923:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863004928 00000100:00100000:0.0:1787857148.371933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863004928 00000100:00100000:0.0:1787857148.372008:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1787857148.372019:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863004928:12345-192.168.204.29@tcp:41:mkdir.0 00000004:00000024:0.0:1787857148.372065:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787857148.372166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863004928:12345-192.168.204.29@tcp:41:mkdir.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857148.372174:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00080000:2.0:1787857148.372393:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857148.373471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.374064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005056 00000100:00100000:2.0:1787857148.374073:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005056 00000100:00100000:2.0:1787857148.374140:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1787857148.374151:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9679:x1874703863005056:12345-192.168.204.29@tcp:700:mkdir.0 00000100:00100000:2.0:1787857148.374238:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9679:x1874703863005056:12345-192.168.204.29@tcp:700:mkdir.0 Request processed in 88us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.374246:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1787857148.382976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.383162:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005312 00000100:00100000:2.0:1787857148.383174:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005312 00000100:00100000:2.0:1787857148.383273:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1787857148.383286:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9679:x1874703863005312:12345-192.168.204.29@tcp:36:mkdir.0 00010000:00010000:2.0:1787857148.383357:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857148.383416:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbe7a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882761 expref: 6 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.383449:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159d00) 00010000:00010000:2.0:1787857148.383464:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857148.385104:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.385134:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.385146:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.385182:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.385191:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.385197:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857148.394645:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787857148.394691:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394703:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394712:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394719:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341aa00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857148.394723:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394731:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394767:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857148.394770:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857148.394775:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.394782:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe8c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857148.394803:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebc5cdf3 reply state 000000007d0502bb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857148.394812:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857148.394939:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9679:x1874703863005312:12345-192.168.204.29@tcp:36:mkdir.0 Request processed in 11651us (11967us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787857148.394948:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00010000:00010000:1.0:1787857148.399335:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399366:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399374:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399382:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341a400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.399387:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399396:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399416:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fd949362000) 00010000:00010000:1.0:1787857148.399420:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.399425:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.399432:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe8cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857148.426152:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857148.430777:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005440 00000100:00100000:1.0:1787857148.430791:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005440 00000100:00100000:1.0:1787857148.430865:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1787857148.430876:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9680:x1874703863005440:12345-192.168.204.29@tcp:101:chmod.0 00010000:00010000:1.0:1787857148.430909:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857148.430930:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827e6 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431024:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431039:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431050:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857148.431109:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787857148.431113:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857148.431156:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431183:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827e6 expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431203:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827e6 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.431211:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fe00) 00010000:00010000:1.0:1787857148.431214:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857148.431218:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953488c00, rc 0) 00000100:00100000:1.0:1787857148.431437:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9680:x1874703863005440:12345-192.168.204.29@tcp:101:chmod.0 Request processed in 562us (5296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857148.431444:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857148.442183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857148.442274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005696 00000100:00100000:1.0:1787857148.442285:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005696 00000100:00100000:1.0:1787857148.442353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1787857148.442362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9680:x1874703863005696:12345-192.168.204.29@tcp:36:chmod.0 00010000:00010000:1.0:1787857148.442417:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857148.442448:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe8dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827e6 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.442469:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fe00) 00010000:00010000:1.0:1787857148.442480:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857148.442504:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.442517:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.442538:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857148.443466:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bec847f reply state 00000000900bba8f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.443477:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787857148.443492:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787857148.445123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:9680:x1874703863005696:12345-192.168.204.29@tcp:36:chmod.0 Request processed in 2754us (2941us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787857148.445135:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00010000:00010000:3.0:1787857148.451577:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451594:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451601:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451621:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857148.451626:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451632:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451647:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:3.0:1787857148.451649:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857148.451654:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.451751:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe8e4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.498584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.500161:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005824 00000100:00100000:2.0:1787857148.500173:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005824 00000100:00100000:2.0:1787857148.500256:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1787857148.500268:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9681:x1874703863005824:12345-192.168.204.29@tcp:101:chown.0 00010000:00010000:2.0:1787857148.500293:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857148.500315:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe8eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827ed expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500381:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500395:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500426:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857148.500484:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787857148.500488:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857148.500545:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500573:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe8eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ed expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500591:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ed expref: 8 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.500600:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857148.500603:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857148.500607:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341be00, rc 0) 00000100:00100000:2.0:1787857148.500716:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:9681:x1874703863005824:12345-192.168.204.29@tcp:101:chown.0 Request processed in 450us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.500724:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:2.0:1787857148.506436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.506576:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863005952 00000100:00100000:0.0:1787857148.506598:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863005952 00000100:00100000:0.0:1787857148.506686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:0.0:1787857148.506697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:9681:x1874703863005952:12345-192.168.204.29@tcp:101:chown.0 00010000:00010000:0.0:1787857148.506716:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857148.506738:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe8f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827f4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.506953:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507024:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507036:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507050:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507057:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507064:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507151:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507159:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507165:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857148.507216:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787857148.507220:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857148.507422:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507433:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507440:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507446:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507452:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857148.507456:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507466:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507480:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857148.507483:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857148.507488:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507494:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507506:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507525:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507538:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507543:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857148.507547:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507552:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507559:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fd953423600) 00010000:00010000:0.0:1787857148.507562:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857148.507565:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507570:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe907 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507602:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827f4 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507615:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827f4 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.507622:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:0.0:1787857148.507625:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857148.507632:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561800, rc 0) 00000100:00100000:0.0:1787857148.507737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:9681:x1874703863005952:12345-192.168.204.29@tcp:101:chown.0 Request processed in 1042us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857148.507744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:0.0:1787857148.511278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.511418:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863006208 00000100:00100000:2.0:1787857148.511428:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863006208 00000100:00100000:2.0:1787857148.511492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1787857148.511503:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:9681:x1874703863006208:12345-192.168.204.29@tcp:36:chown.0 00010000:00010000:2.0:1787857148.511556:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857148.511580:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe90e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827f4 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.511626:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:2.0:1787857148.511639:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857148.511709:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.511722:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.511732:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857148.592270:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787857148.592293:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787857148.592420:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002caab8e7 reply state 00000000c15f4398 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857148.592435:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787857148.592907:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787857148.593167:0:5836:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787857148.593191:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9681:x1874703863006208:12345-192.168.204.29@tcp:36:chown.0 Request processed in 81686us (81918us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787857148.593201:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00010000:00010000:3.0:1787857148.593459:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593469:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593489:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593496:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341ba00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857148.593501:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593532:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593595:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd949362a00) 00010000:00010000:3.0:1787857148.593599:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857148.593604:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.593635:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe915 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.626913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857148.627446:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863006336 00000100:00100000:1.0:1787857148.627458:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863006336 00000100:00100000:1.0:1787857148.627528:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:1.0:1787857148.627538:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9682:x1874703863006336:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:1.0:1787857148.627563:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857148.627584:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe91c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8827fb expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857148.629156:0:8856:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1518us 00010000:00010000:1.0:1787857148.650796:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.650820:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.650844:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.650860:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.650867:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.650873:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651345:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651357:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651373:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857148.651464:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857148.651468:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857148.651574:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651587:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651592:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651608:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651613:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.651617:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651625:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651636:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:1.0:1787857148.651639:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.651643:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651651:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651714:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651720:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651725:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651729:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.651732:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651745:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651753:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fd963a5fe00) 00010000:00010000:1.0:1787857148.651755:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.651758:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651764:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe92a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651800:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe91c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827fb expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651815:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827fb expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.651823:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:1.0:1787857148.651825:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857148.651827:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489600, rc 0) 00000100:00100000:1.0:1787857148.651894:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9682:x1874703863006336:12345-192.168.204.29@tcp:101:touch.500 Request processed in 24357us (24989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857148.651903:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857148.660535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.660621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863006592 00000100:00100000:0.0:1787857148.660631:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863006592 00000100:00100000:0.0:1787857148.660745:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:0.0:1787857148.660756:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9682:x1874703863006592:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:0.0:1787857148.660776:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857148.660797:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882802 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661140:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661156:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661168:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661241:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.661257:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857148.662120:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787857148.662431:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe94d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662443:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662453:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662488:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662495:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662502:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662508:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857148.662512:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662520:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662533:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:0.0:1787857148.662536:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857148.662540:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662558:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe93f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857148.662571:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000449b25f5 reply state 0000000069fdcc8c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.662580:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787857148.662612:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882802 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662626:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882802 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.662634:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423000) 00010000:00010000:0.0:1787857148.662636:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857148.662639:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857148.662732:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:9682:x1874703863006592:12345-192.168.204.29@tcp:101:touch.500 Request processed in 1978us (2207us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787857148.662740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00010000:00010000:1.0:1787857148.664538:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664553:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664581:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664588:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.664593:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664600:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664616:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9fd953423600) 00010000:00010000:1.0:1787857148.664619:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.664623:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.664630:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe946 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857148.670253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.670321:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863006848 00000100:00100000:0.0:1787857148.670332:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863006848 00000100:00100000:0.0:1787857148.670393:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1787857148.670404:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:9682:x1874703863006848:12345-192.168.204.29@tcp:36:touch.500 00010000:00010000:0.0:1787857148.670462:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857148.674945:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe94d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882802 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.675009:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423000) 00010000:00010000:0.0:1787857148.675023:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857148.675085:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.675098:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.675108:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857148.675266:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ab1e8b9 reply state 00000000797cb2ed transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.675277:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857148.675395:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:9682:x1874703863006848:12345-192.168.204.29@tcp:36:touch.500 Request processed in 4992us (5150us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787857148.675405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:1.0:1787857148.682480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.682708:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863006976 00000100:00100000:2.0:1787857148.682719:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863006976 00000100:00100000:2.0:1787857148.682779:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1787857148.682790:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:9682:x1874703863006976:12345-192.168.204.29@tcp:101:touch.500 00010000:00010000:2.0:1787857148.682814:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857148.682835:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882809 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.682916:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882809 expref: 11 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.682946:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882809 expref: 11 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.682967:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:2.0:1787857148.682971:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857148.682974:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341aa00, rc 0) 00000100:00100000:2.0:1787857148.683039:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:9682:x1874703863006976:12345-192.168.204.29@tcp:101:touch.500 Request processed in 251us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.683046:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00010000:00010000:3.0:1787857148.683743:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683754:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683760:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683766:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857148.683771:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683779:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683792:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:3.0:1787857148.683795:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857148.683799:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857148.683806:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe95b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857148.690148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857148.690279:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863007104 00000100:00100000:3.0:1787857148.690290:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863007104 00000100:00100000:3.0:1787857148.690342:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:3.0:1787857148.690350:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863007104:12345-192.168.204.29@tcp:8:touch.500 00010000:00080000:3.0:1787857148.690385:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1787857148.690414:0:6678:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbe969 00002000:00100000:3.0:1787857148.690427:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1/ffff9fd9756dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857148.690453:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857148.690730:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787857148.690765:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd9756de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857148.690948:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703863007104:12345-192.168.204.29@tcp:8:touch.500 Request processed in 596us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.690956:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857148.698383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.698542:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863007232 00000100:00100000:2.0:1787857148.698551:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863007232 00000100:00100000:2.0:1787857148.698731:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1787857148.699082:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:0:x1874703863007232:12345-192.168.204.29@tcp:2:touch.500 00000100:00080000:1.0:1787857148.699515:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787857148.796093:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787857148.796124:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000100:00100000:2.0:1787857148.796377:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:0:x1874703863007232:12345-192.168.204.29@tcp:2:touch.500 Request processed in 97630us (97996us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787857148.796388:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1787857148.809077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.809909:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863007488 00000100:00100000:2.0:1787857148.810030:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863007488 00000100:00100000:2.0:1787857148.810162:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1787857148.810189:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:9682:x1874703863007488:12345-192.168.204.29@tcp:35:touch.500 00000100:00100000:2.0:1787857148.810829:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:9682:x1874703863007488:12345-192.168.204.29@tcp:35:touch.500 Request processed in 642us (1910us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787857148.810839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857148.839998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.841181:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863007616 00000100:00100000:2.0:1787857148.841193:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863007616 00000100:00100000:2.0:1787857148.842807:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1787857148.842825:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:9683:x1874703863007616:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1787857148.842853:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857148.842876:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbe970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882810 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.842952:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.842966:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.842978:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857148.843052:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787857148.843057:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857148.843183:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.843214:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbe970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882810 expref: 13 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.843273:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882810 expref: 12 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.843282:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:2.0:1787857148.843285:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857148.843288:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a400, rc 0) 00000100:00100000:2.0:1787857148.843364:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:9683:x1874703863007616:12345-192.168.204.29@tcp:101:rm.0 Request processed in 546us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.843372:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1787857148.859338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.859418:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863007872 00000100:00100000:0.0:1787857148.859429:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863007872 00000100:00100000:0.0:1787857148.859497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:0.0:1787857148.859509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:9683:x1874703863007872:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1787857148.859539:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857148.859560:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe97e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882817 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857148.859712:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787857148.859867:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe97e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882817 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.859881:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857148.859884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857148.859889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe97e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882817 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.859904:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857148.860342:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:9683:x1874703863007872:12345-192.168.204.29@tcp:101:rm.0 Request processed in 835us (1017us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787857148.860351:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1787857148.872872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.874298:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863008000 00000100:00100000:2.0:1787857148.874312:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863008000 00000100:00100000:2.0:1787857148.874387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1787857148.874399:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:9683:x1874703863008000:12345-192.168.204.29@tcp:37:rm.0 00000100:00100000:2.0:1787857148.883472:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:9683:x1874703863008000:12345-192.168.204.29@tcp:37:rm.0 Request processed in 9065us (10600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.883486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1787857148.891744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.891835:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863008256 00000100:00100000:0.0:1787857148.891845:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863008256 00000100:00100000:0.0:1787857148.891912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1787857148.891922:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d466850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:9683:x1874703863008256:12345-192.168.204.29@tcp:35:rm.0 00000100:00100000:0.0:1787857148.892200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d466850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:9683:x1874703863008256:12345-192.168.204.29@tcp:35:rm.0 Request processed in 279us (465us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787857148.892208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1787857148.899382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.899587:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863008512 00000100:00100000:2.0:1787857148.899597:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863008512 00000100:00100000:2.0:1787857148.899681:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1787857148.899692:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:9683:x1874703863008512:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:2.0:1787857148.899718:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857148.899738:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbe98c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88281e expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.899878:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe993 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.899892:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe993 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.899902:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe993 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857148.899911:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787857148.900028:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbe98c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88281e expref: 17 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.900046:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe993 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88281e expref: 16 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.900055:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:2.0:1787857148.900057:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787857148.900061:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ba00, rc 0) 00000100:00100000:2.0:1787857148.900135:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863008512:12345-192.168.204.29@tcp:101:rm.0 Request processed in 445us (763us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787857148.900145:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1787857148.906326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857148.906394:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863008640 00000100:00100000:2.0:1787857148.906404:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863008640 00000100:00100000:2.0:1787857148.906464:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:2.0:1787857148.906474:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863008640:12345-192.168.204.29@tcp:41:rm.0 00000004:00000024:2.0:1787857148.906535:0:8075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787857148.906628:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863008640:12345-192.168.204.29@tcp:41:rm.0 Request processed in 155us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857148.906636:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:3.0:1787857148.908919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.909327:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863008768 00000100:00100000:0.0:1787857148.909337:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863008768 00000100:00100000:0.0:1787857148.909395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:0.0:1787857148.909406:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863008768:12345-192.168.204.29@tcp:101:rm.0 00010000:00010000:0.0:1787857148.909424:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857148.909446:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe9a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882825 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909529:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909543:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909555:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909569:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909576:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.909583:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909864:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909874:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909892:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857148.909921:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787857148.909925:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857148.909946:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909958:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909966:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909972:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909979:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909984:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.909988:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.909995:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:1.0:1787857148.910010:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.910014:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910029:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbe9a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910042:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910048:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910054:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910058:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.910061:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910067:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910074:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9fd953423a00) 00010000:00010000:1.0:1787857148.910076:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.910080:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910086:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbe9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910116:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbe9a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882825 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910129:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882825 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.910143:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:1.0:1787857148.910145:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857148.910148:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489a00, rc 0) 00000100:00100000:1.0:1787857148.910225:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:9683:x1874703863008768:12345-192.168.204.29@tcp:101:rm.0 Request processed in 812us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857148.910232:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:1.0:1787857148.914572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.914689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009024 00000100:00100000:0.0:1787857148.914700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009024 00000100:00100000:0.0:1787857148.914768:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1787857148.914779:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:9683:x1874703863009024:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1787857148.914833:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787857148.914861:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882825 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914882:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341aa00/0xf326646fe3bbe962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882809 expref: 16 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914910:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:0.0:1787857148.914928:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341a400/0xf326646fe3bbe977 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882810 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914936:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:0.0:1787857148.914939:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857148.914959:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914972:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914981:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.914994:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915002:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915008:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915157:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915166:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915183:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857148.915836:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787857148.915846:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303244185651ns, next at 304244183492ns, rc = 0 00010000:00010000:0.0:1787857148.915900:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915917:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915924:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915931:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915937:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915952:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857148.915968:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915974:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915980:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.915991:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857148.915996:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916003:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916011:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857148.916014:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857148.916017:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916023:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbe9cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916037:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916043:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916049:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916054:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857148.916056:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916062:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916077:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:0.0:1787857148.916079:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857148.916082:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857148.916088:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbe9bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857148.916098:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2d37685 reply state 000000006a9730f8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857148.916106:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857148.916181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863009024:12345-192.168.204.29@tcp:36:rm.0 Request processed in 1403us (1621us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787857148.916188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00010000:00010000:1.0:1787857148.916610:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857148.916618:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.916625:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857148.916628:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.916635:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.916645:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fd953423200) 00010000:00010000:1.0:1787857148.916647:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857148.916650:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.916676:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561800/0xf326646fe3bbe9d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.916691:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857148.916693:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857148.916695:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857148.919455:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919473:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919480:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919485:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.919489:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919496:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919513:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9fd953423000) 00010000:00010000:1.0:1787857148.919516:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.919532:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.919540:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbe9c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857148.928420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857148.929269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009280 00000100:00100000:0.0:1787857148.929281:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009280 00000100:00100000:0.0:1787857148.929389:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1787857148.929400:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:9683:x1874703863009280:12345-192.168.204.29@tcp:35:rm.0 00000100:00100000:0.0:1787857148.929755:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863009280:12345-192.168.204.29@tcp:35:rm.0 Request processed in 357us (1346us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787857148.929765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1787857148.933248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857148.939506:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009536 00000100:00100000:1.0:1787857148.939686:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009536 00000100:00100000:1.0:1787857148.939868:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:1.0:1787857148.939880:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:9683:x1874703863009536:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:1.0:1787857148.939938:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857148.939964:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ba00/0xf326646fe3bbe993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88281e expref: 16 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940005:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbe931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827fb expref: 15 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940016:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:1.0:1787857148.940031:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbe8f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827ed expref: 14 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940039:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362100) 00010000:00010000:1.0:1787857148.940045:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857148.940069:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940081:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940090:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940102:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940110:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.940116:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.943477:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.943518:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.943636:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857148.949088:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787857148.949114:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949123:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949130:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949137:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.949142:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949149:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949165:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857148.949168:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787857148.949173:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949179:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbe9e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949204:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949232:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949238:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949243:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857148.949246:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949253:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949260:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fe00) 00010000:00010000:1.0:1787857148.949263:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857148.949266:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857148.949271:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbe9d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857148.949283:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a75d3832 reply state 000000002af9dfb4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857148.949291:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857148.949396:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:9683:x1874703863009536:12345-192.168.204.29@tcp:36:rm.0 Request processed in 9515us (16158us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787857148.949405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00010000:00010000:2.0:1787857148.958278:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958295:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958302:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958309:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857148.958313:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958321:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958337:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fd963a5f500) 00010000:00010000:2.0:1787857148.958340:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857148.958345:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857148.958351:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbe9e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857149.384741:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857150.308806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857150.308839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857150.308862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857150.308908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857150.308939:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009664 00000100:00100000:2.0:1787857150.308949:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009664 00000100:00100000:2.0:1787857150.309001:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 245 00000100:00100000:2.0:1787857150.309011:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863009664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857150.309155:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863009664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 144us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857150.309164:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 245 00000100:00100000:2.0:1787857150.309206:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009920 00000100:00100000:2.0:1787857150.309210:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009920 00000100:00100000:2.0:1787857150.309246:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1787857150.309253:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863009920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857150.309281:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863009920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857150.309288:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1787857150.309304:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863009792 00000100:00100000:2.0:1787857150.309307:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863009792 00000100:00100000:2.0:1787857150.309333:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010048 00000100:00100000:2.0:1787857150.309336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010048 00000100:00100000:2.0:1787857150.309353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:2.0:1787857150.309359:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2354:x1874703863009792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857150.309390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2354:x1874703863009792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857150.309396:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:2.0:1787857150.309407:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:2.0:1787857150.309413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863010048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857150.309444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863010048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857150.309449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00080000:2.0:1787857150.314711:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857150.314721:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857150.407921:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857151.431903:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857151.816917:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885060480:0@lo:400:kworker.0 00000100:00100000:0.0:1787857151.816996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857151.817072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857151.817079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885060352:0@lo:400:kworker.0 00000100:00100000:2.0:1787857151.817421:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885060096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.817486:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885060224:0@lo:400:kworker.0 00000004:00080000:3.0:1787857151.817534:0:8074:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306145871905ns, next at 307145869392ns, rc = 0 00000100:00100000:3.0:1787857151.817562:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060480 00000100:00100000:3.0:1787857151.817570:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060480 00000100:00100000:3.0:1787857151.817635:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787857151.817644:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885060480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.819237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857151.819300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857151.819302:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885060736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.819346:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857151.819349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885060608:0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.819813:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885060864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857151.819847:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857151.819884:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060224 00000100:00100000:1.0:1787857151.819893:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060224 00000100:00100000:1.0:1787857151.819957:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787857151.819967:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885060224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.820020:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885060224:12345-0@lo:400:kworker.0 Request processed in 54us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.820027:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787857151.820053:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060096 00000100:00100000:1.0:1787857151.820057:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060096 00000100:00100000:1.0:1787857151.820081:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787857151.820087:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885060096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.820117:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885060096:12345-0@lo:400:kworker.0 Request processed in 31us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.820136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787857151.820172:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060864 00000100:00100000:1.0:1787857151.820176:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060864 00000100:00100000:1.0:1787857151.820206:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787857151.820212:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885060864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857151.820240:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857151.820315:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885060864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.820340:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787857151.821497:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd975a45e00 x1874703885060864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857151.821597:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885060864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857151.821650:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885060224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.821893:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060736 00000100:00100000:3.0:1787857151.821940:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885060480:12345-0@lo:400:kworker.0 Request processed in 4295us (4942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857151.821949:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787857151.822065:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060736 00000100:00100000:1.0:1787857151.822192:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787857151.822204:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885060736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.822274:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885060736:12345-0@lo:400:kworker.0 Request processed in 74us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.822281:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787857151.822305:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857151.822312:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787857151.822343:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b4000 x1874703885060736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857151.822356:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885060736:0@lo:400:kworker.0 00000100:00100000:2.0:1787857151.823574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857151.823638:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885060096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.823642:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060608 00000100:00100000:1.0:1787857151.823650:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060608 00000100:00100000:1.0:1787857151.824151:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787857151.824172:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885060608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.824241:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885060608:12345-0@lo:400:kworker.0 Request processed in 82us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.824248:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787857151.824391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857151.825867:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885060608:0@lo:400:kworker.0 00010000:00080000:0.0:1787857151.826547:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96d8b7840 x1874703885060480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857151.826562:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885060480:0@lo:400:kworker.0 00000100:00080000:2.0:1787857151.832147:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857151.836384:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060352 00000100:00100000:1.0:1787857151.836404:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060352 00000100:00100000:1.0:1787857151.836655:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787857151.836681:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857151.836789:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885060352:12345-0@lo:400:kworker.0 Request processed in 111us (12399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857151.836796:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787857151.836968:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885060352:0@lo:400:kworker.0 00000100:00080000:2.0:1787857151.837958:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857152.455879:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857152.567942:0:11603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787857152.839980:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885060992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857152.840075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857152.840454:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885060992 00000100:00100000:1.0:1787857152.840465:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885060992 00000100:00100000:1.0:1787857152.840738:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787857152.840751:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885060992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857152.840797:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857152.840873:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885060992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857152.840880:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787857152.840962:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd947e78b40 x1874703885060992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857152.840981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885060992:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1787857153.442410:0:11651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0c77830 20000000:00000080:0.0:1787857153.442431:0:11651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd942f11800 uarg=0000000000000000 20000000:01000000:0.0:1787857153.442468:0:11651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787857153.442475:0:11651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787857153.442480:0:11651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787857153.443502:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787857153.443919:0:11651:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787857153.452494:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787857153.452569:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787857153.452638:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787857153.452674:0:11651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787857153.452710:0:11651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452731:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452740:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452749:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452771:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452778:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452785:0:11651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452833:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.452851:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 18 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.452865:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061120:0@lo:104: 00000100:00100000:0.0:1787857153.452992:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857153.453076:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.453085:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 18 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.453093:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061248:0@lo:104: 00000100:00100000:0.0:1787857153.453115:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857153.453153:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.453162:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 18 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.453178:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061376:0@lo:104: 00000100:00100000:0.0:1787857153.453201:0:11651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857153.453220:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.453230:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 12 pid: 5829 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.453240:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061504:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857153.453314:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.453323:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.453332:0:11651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061632:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857153.453357:0:11651:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948be0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787857153.453537:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787857153.453552:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885061120 00000100:00100000:2.0:1787857153.453559:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885061120 00000100:00100000:2.0:1787857153.453597:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885061248 00000100:00100000:2.0:1787857153.453599:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885061248 00000100:00100000:2.0:1787857153.453607:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885061376 00000100:00100000:2.0:1787857153.453608:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885061376 00000100:00100000:2.0:1787857153.453620:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857153.453629:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:11651:x1874703885061120:12345-0@lo:104: 00010000:00010000:2.0:1787857153.453641:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.453749:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787857153.453762:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+5:11651:x1874703885061120:12345-0@lo:104: Request processed in 134us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857153.453769:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857153.453793:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787857153.453804:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:11651:x1874703885061248:12345-0@lo:104: 00010000:00010000:2.0:1787857153.453814:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.453852:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787857153.453857:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+4:11651:x1874703885061248:12345-0@lo:104: Request processed in 56us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857153.453862:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787857153.453875:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787857153.453880:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b57d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:11651:x1874703885061376:12345-0@lo:104: 00010000:00010000:2.0:1787857153.453888:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.453921:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787857153.453927:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b57d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+3:11651:x1874703885061376:12345-0@lo:104: Request processed in 47us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857153.453932:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787857153.453961:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787857153.453971:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.453974:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857153.453983:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.453985:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857153.453993:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.453995:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488a00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857153.454001:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454022:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857153.454030:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857153.454035:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857153.454066:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454072:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857153.454077:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857153.454089:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454094:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454103:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953488a00/0xf326646fe3bbe8ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8b3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857153.454117:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787857153.454139:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857153.454144:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454150:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489c00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857153.454153:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454156:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454164:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454168:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1787857153.454176:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454180:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454199:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe8ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8c1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857153.454200:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787857153.454221:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857153.454222:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454224:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857153.454227:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857153.454233:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857153.454252:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857153.454257:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885061888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857153.454264:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbe89e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbe8a5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.454280:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857153.454282:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857153.454284:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857153.454293:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857153.454476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857153.454522:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857153.454529:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885061760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857153.454554:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857153.454589:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885061888 00000100:00100000:1.0:1787857153.454594:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885061888 00010000:00010000:1.0:1787857153.454618:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857153.454641:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885061760 00000100:00100000:1.0:1787857153.454644:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885061760 00010000:00010000:1.0:1787857153.454656:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 20 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857153.454713:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787857153.454720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3310:x1874703885061888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857153.454735:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857153.454742:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 20 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454752:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 20 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454779:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857153.454812:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+20:3310:x1874703885061888:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857153.454818:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787857153.454924:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787857153.454931:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885061760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857153.454940:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857153.454945:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454955:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.454965:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857153.454991:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885061760:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857153.454997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787857153.455035:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885062016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857153.455055:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885061760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857153.455075:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857153.455081:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885061888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857153.455223:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062016 00000100:00100000:2.0:1787857153.455229:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062016 00010000:00010000:2.0:1787857153.455251:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857153.455277:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787857153.455284:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885062016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787857153.455292:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857153.455296:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.455307:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 19 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.455329:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857153.455364:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885062016:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857153.455372:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787857153.455492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885062016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857153.455755:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216ca00/0xf326646fe3bbe8c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe8ba expref: 18 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.455773:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061120:0@lo:104: 00010000:00010000:0.0:1787857153.455792:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216cc00/0xf326646fe3bbe8b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe8ac expref: 17 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.455801:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061248:0@lo:104: 00010000:00010000:0.0:1787857153.455810:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d600/0xf326646fe3bbe8a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbe89e expref: 16 pid: 5830 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857153.455834:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061376:0@lo:104: 00000100:00100000:0.0:1787857153.457175:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061504:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857153.457187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857153.457194:0:11651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1874703885061632:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857153.457235:0:11651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857153.457265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857153.457319:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010176 00000100:00100000:1.0:1787857153.457326:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010176 00010000:00010000:1.0:1787857153.457356:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 13 pid: 5829 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857153.457387:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010304 00000100:00100000:1.0:1787857153.457391:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010304 00010000:00010000:1.0:1787857153.457403:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 14 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857153.457416:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857153.457424:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+14:2353:x1874703863010176:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857153.457437:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857153.457442:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 14 pid: 5829 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457452:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 14 pid: 5829 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457468:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ae00/0xf326646fe3bbe897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827df expref: 14 pid: 5829 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457480:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857153.457527:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863010176:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857153.457534:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857153.457549:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:1.0:1787857153.457565:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:2353:x1874703863010304:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857153.457572:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857153.457576:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457585:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457596:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b400/0xf326646fe3bbe890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827d8 expref: 12 pid: 5830 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457606:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457615:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457632:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457640:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457648:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457654:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457796:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857153.457800:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457815:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457835:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.457844:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857153.457876:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:2353:x1874703863010304:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 310us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857153.457883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00010000:00010000:0.0:1787857153.458136:0:11651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.458145:0:11651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.458151:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975560c00/0xf326646fe3bbe9ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857153.483604:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787857153.938573:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1787857153.938590:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787857153.938617:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787857153.938627:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1787857153.941087:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857153.941114:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885062144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787857153.941207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857153.941596:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062144 00000100:00100000:2.0:1787857153.941605:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062144 00000100:00100000:2.0:1787857153.941703:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787857153.941713:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885062144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857153.941742:0:6676:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787857153.941778:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9088fc, atime: 0x6a9088fc, ctime: 0x6a9088fc, blocks: 0x1 00010000:00010000:2.0:1787857153.941786:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.941803:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1787857153.941808:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857153.941814:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.941831:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.941863:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.941871:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857153.941885:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857153.942606:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885062144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 894us (1398us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787857153.942615:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787857153.942710:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857153.943109:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857153.943128:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.943138:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341be00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857153.943143:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.943153:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.943180:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.943187:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b62e84/0xf326646fe3bbe9f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857153.943208:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857153.943210:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857153.943212:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787857153.943253:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd947e79a40/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787857153.943261:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885062144:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787857154.503933:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787857155.143850:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857155.143859:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd975d01000 from 7 10000000:01000000:1.0:1787857155.143865:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857155.143916:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857155.143929:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857155.143942:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857155.143968:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857155.144055:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857155.144125:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.144355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062272 00000100:00100000:2.0:1787857155.144363:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062272 00000100:00100000:2.0:1787857155.144472:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787857155.144483:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:5833:x1874703885062272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857155.144496:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857155.144510:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbea03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbe9fc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.144544:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbea03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbe9fc expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.144556:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbea03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbe9fc expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.144581:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ba00, rc 0) 00000100:00100000:2.0:1787857155.144719:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.144727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787857155.145469:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857155.145486:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.145496:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857155.145577:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.145616:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857155.145651:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.145959:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062400 00000100:00100000:2.0:1787857155.145965:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062400 00000100:00100000:2.0:1787857155.146018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787857155.146027:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.148791:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2758us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.148804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787857155.155599:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.155676:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.155764:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857155.155802:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857155.155951:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062528 00000100:00100000:0.0:1787857155.155958:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062528 00000100:00100000:0.0:1787857155.156029:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787857155.156038:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857155.156282:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857155.156290:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787857155.157325:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.160435:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11666:1874703885062656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.160546:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857155.160609:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857155.161743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062656 00000100:00100000:0.0:1787857155.161755:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062656 00000100:00100000:0.0:1787857155.161832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787857155.161842:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:11666:x1874703885062656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857155.162134:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:11666:x1874703885062656:12345-0@lo:502:llog_process_th.0 Request processed in 293us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857155.162142:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787857155.167246:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11666:1874703885062656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857155.167295:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857155.167310:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857155.167312:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787857155.167320:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd975d01000 00000020:00000080:3.0:1787857155.167323:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787857155.167443:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11666:1874703885062784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.167543:0:11666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857155.167601:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.168001:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062784 00000100:00100000:2.0:1787857155.168024:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062784 00000100:00100000:2.0:1787857155.168101:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787857155.168112:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:11666:x1874703885062784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857155.168353:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:11666:x1874703885062784:12345-0@lo:502:llog_process_th.0 Request processed in 241us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.168360:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787857155.168838:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11666:1874703885062784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857155.168865:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857155.168871:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857155.168874:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787857155.168879:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787857155.169106:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787857155.169128:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787857155.169147:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857155.169159:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857155.169169:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787857155.169171:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd950737800 from 7 10000000:01000000:1.0:1787857155.169174:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857155.169207:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857155.169216:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857155.169225:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857155.169241:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787857155.169279:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857155.169330:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.172045:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885062912 00000100:00100000:2.0:1787857155.172057:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885062912 00000100:00100000:2.0:1787857155.172126:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787857155.172137:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:5833:x1874703885062912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857155.172154:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857155.172173:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbea11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbea0a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.172212:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbea11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbea0a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.172242:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbea11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbea0a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.172256:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341a400, rc 0) 00000100:00100000:2.0:1787857155.172351:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885062912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.172358:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787857155.172432:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885062912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857155.172449:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.172459:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857155.172538:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.172591:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.172623:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.172638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063040 00000100:00100000:2.0:1787857155.172641:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063040 00000100:00100000:2.0:1787857155.172688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787857155.172695:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885063040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.173285:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885063040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 588us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.173293:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787857155.173333:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.173747:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.173792:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.173862:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.173878:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063168 00000100:00100000:2.0:1787857155.173882:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063168 00000100:00100000:2.0:1787857155.173913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787857155.173920:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885063168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.175827:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885063168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1880us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.175841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787857155.184170:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.197624:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11669:1874703885063296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.197799:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857155.197840:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857155.197956:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063296 00000100:00100000:2.0:1787857155.197964:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063296 00000100:00100000:2.0:1787857155.198012:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787857155.198021:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:11669:x1874703885063296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857155.198238:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9457a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:11669:x1874703885063296:12345-0@lo:502:llog_process_th.0 Request processed in 217us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.198246:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787857155.198468:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11669:1874703885063296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857155.198496:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857155.198506:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857155.198508:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787857155.198515:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd950737800 00000020:00000080:0.0:1787857155.198518:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787857155.198592:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11669:1874703885063424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857155.198629:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857155.198696:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948be03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857155.198804:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063424 00000100:00100000:3.0:1787857155.198809:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063424 00000100:00100000:3.0:1787857155.198846:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787857155.198854:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:11669:x1874703885063424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.198989:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:11669:x1874703885063424:12345-0@lo:502:llog_process_th.0 Request processed in 136us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.199005:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787857155.199043:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a96d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11669:1874703885063424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857155.199063:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857155.199068:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857155.199069:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787857155.199073:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787857155.203344:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787857155.203379:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857155.203391:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.203405:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857155.203416:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857155.203419:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96116a000 from 7 10000000:01000000:2.0:1787857155.203429:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857155.203467:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.203476:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.203487:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857155.203516:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.203586:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.203634:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857155.204823:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063552 00000100:00100000:0.0:1787857155.204832:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063552 00000100:00100000:0.0:1787857155.204880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787857155.204891:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:5833:x1874703885063552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857155.204906:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857155.204924:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975561800/0xf326646fe3bbea1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbea18 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857155.204950:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975561800/0xf326646fe3bbea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbea18 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857155.204961:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975561800/0xf326646fe3bbea1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbea18 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857155.204970:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561800, rc 0) 00000100:00100000:0.0:1787857155.205026:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885063552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857155.205032:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000040:00080000:1.0:1787857155.208015:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787857155.209206:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857155.209235:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857155.209248:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857155.209319:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.209381:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.209426:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857155.213448:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063680 00000100:00100000:0.0:1787857155.213473:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063680 00000100:00100000:0.0:1787857155.213530:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787857155.213541:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885063680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857155.213870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885063680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857155.213878:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787857155.214570:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.214624:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.214829:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.214869:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857155.215000:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063808 00000100:00100000:3.0:1787857155.215006:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063808 00000100:00100000:3.0:1787857155.215045:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787857155.215054:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885063808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.215253:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:5833:x1874703885063808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.215261:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787857155.215626:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:77122e39-57f8-4b24-9fe4-5b00eda54f16:5833:1874703885063808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857155.222221:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11671:1874703885063936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857155.222313:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857155.222378:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857155.222479:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885063936 00000100:00100000:3.0:1787857155.222487:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885063936 00000100:00100000:3.0:1787857155.222540:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787857155.222550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:11671:x1874703885063936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.222804:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:11671:x1874703885063936:12345-0@lo:502:llog_process_th.0 Request processed in 255us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.222813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787857155.228525:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11671:1874703885063936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787857155.228571:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857155.228582:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857155.228585:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787857155.228593:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd96116a000 00000020:00000080:1.0:1787857155.228596:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787857155.228710:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e783c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11671:1874703885064064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787857155.228786:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857155.228844:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857155.229167:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064064 00000100:00100000:3.0:1787857155.229175:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064064 00000100:00100000:3.0:1787857155.229225:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787857155.229233:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:11671:x1874703885064064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857155.229483:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:11671:x1874703885064064:12345-0@lo:502:llog_process_th.0 Request processed in 250us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.229497:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787857155.230709:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e783c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:77122e39-57f8-4b24-9fe4-5b00eda54f16:11671:1874703885064064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787857155.230748:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857155.230757:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857155.230759:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787857155.230765:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787857155.230968:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787857155.230988:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787857155.230999:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.231010:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857155.241035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.241123:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010432 00000100:00100000:3.0:1787857155.241134:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010432 00000100:00100000:3.0:1787857155.241191:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 262 00000100:00100000:3.0:1787857155.241200:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:5594:x1874703863010432:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857155.241215:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857155.241232:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbea26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88282c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.241258:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88282c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.241268:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88282c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.241277:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045c00, rc 0) 00000100:00100000:3.0:1787857155.241341:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863010432:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.241348:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 262 00000100:00100000:2.0:1787857155.243180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.243253:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010560 00000100:00100000:3.0:1787857155.243266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010560 00000100:00100000:3.0:1787857155.243689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 263 00000100:00100000:3.0:1787857155.243700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863010560:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.243942:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863010560:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 244us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.243950:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 263 00000100:00100000:2.0:1787857155.252812:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.254987:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010688 00000100:00100000:3.0:1787857155.255003:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010688 00000100:00100000:3.0:1787857155.255068:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 264 00000100:00100000:3.0:1787857155.255079:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863010688:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.255416:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863010688:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 338us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.255425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 264 00000100:00100000:3.0:1787857155.268823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.268863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010816 00000100:00100000:3.0:1787857155.268871:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010816 00000100:00100000:3.0:1787857155.268917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 265 00000100:00100000:3.0:1787857155.268925:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:9953:x1874703863010816:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787857155.269224:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:9953:x1874703863010816:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 298us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.269232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 265 00000100:00100000:1.0:1787857155.272496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.272583:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863010944 00000100:00100000:3.0:1787857155.272592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863010944 00000100:00100000:3.0:1787857155.272647:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 266 00000100:00100000:3.0:1787857155.272656:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:9953:x1874703863010944:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787857155.272922:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:9953:x1874703863010944:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 266us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.272930:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 266 00000100:00100000:0.0:1787857155.278915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.279111:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011072 00000100:00100000:3.0:1787857155.279126:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011072 00000100:00100000:3.0:1787857155.279192:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 267 00000100:00100000:3.0:1787857155.279203:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:5594:x1874703863011072:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857155.279222:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857155.279242:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045600/0xf326646fe3bbea2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882833 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.279273:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045600/0xf326646fe3bbea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882833 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.279285:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045600/0xf326646fe3bbea2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882833 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857155.279295:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045600, rc 0) 00000100:00100000:3.0:1787857155.279485:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863011072:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 282us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.279492:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 267 00000100:00100000:1.0:1787857155.282764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.282898:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011200 00000100:00100000:3.0:1787857155.282916:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011200 00000100:00100000:3.0:1787857155.282972:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:3.0:1787857155.282982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863011200:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.283285:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863011200:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 304us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.283301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 268 00000100:00100000:1.0:1787857155.290544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.290614:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011328 00000100:00100000:3.0:1787857155.290625:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011328 00000100:00100000:3.0:1787857155.290718:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:3.0:1787857155.290729:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863011328:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857155.290966:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:5594:x1874703863011328:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 238us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857155.290975:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 269 00000100:00100000:1.0:1787857155.299218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857155.300189:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011456 00000100:00100000:2.0:1787857155.300201:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011456 00000100:00100000:2.0:1787857155.300263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:2.0:1787857155.300274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:9956:x1874703863011456:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857155.300532:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:9956:x1874703863011456:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 259us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.300540:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 270 00000100:00100000:1.0:1787857155.311770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857155.311856:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011584 00000100:00100000:0.0:1787857155.311868:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011584 00000100:00100000:0.0:1787857155.311930:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 271 00000100:00100000:0.0:1787857155.311940:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:9956:x1874703863011584:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857155.312215:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:9956:x1874703863011584:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 275us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857155.312223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 271 00000100:00100000:1.0:1787857155.434922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857155.435049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857155.435183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857155.435200:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011840 00000100:00100000:3.0:1787857155.435226:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011840 00000100:00100000:3.0:1787857155.435340:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1787857155.435352:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863011840:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857155.435516:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011712 00000100:00100000:2.0:1787857155.435521:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011712 00000100:00100000:2.0:1787857155.435560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863011968 00000100:00100000:2.0:1787857155.435563:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863011968 00000100:00100000:3.0:1787857155.435588:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863011840:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 237us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.435596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:3.0:1787857155.435599:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:2.0:1787857155.435610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863011712:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1787857155.435626:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857155.435632:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857155.435690:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863011712:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 84us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.435698:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:2.0:1787857155.435712:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:2.0:1787857155.435720:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863011968:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857155.436034:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863011968:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 313us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857155.436055:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00010000:00010000:2.0:1787857155.528132:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857156.232329:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787857156.552625:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857156.935952:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885064192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.935990:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885064576:0@lo:400:kworker.0 00000100:00100000:0.0:1787857156.936046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885064448:0@lo:400:kworker.0 00000100:00100000:1.0:1787857156.939325:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885064320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857156.940161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857156.940287:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064576 00000100:00100000:2.0:1787857156.940294:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064576 00000100:00100000:2.0:1787857156.940354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787857156.940377:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885064576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.940446:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885064576:12345-0@lo:400:kworker.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857156.940453:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1787857156.940472:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857156.940503:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885064576:0@lo:400:kworker.0 00000100:00100000:3.0:1787857156.947295:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857156.947384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064192 00000100:00100000:2.0:1787857156.947396:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064192 00000100:00100000:3.0:1787857156.947409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885064704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.947451:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787857156.947460:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885064192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857156.947468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857156.947494:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064704 00000100:00100000:3.0:1787857156.947497:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064704 00000100:00100000:2.0:1787857156.947516:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885064192:12345-0@lo:400:kworker.0 Request processed in 58us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857156.947524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1787857156.947568:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857156.947595:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885064192:0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.947632:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787857156.947640:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885064704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.947694:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885064704:12345-0@lo:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857156.947716:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787857156.947747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd981ee1a40 x1874703885064704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857156.947760:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885064704:0@lo:400:kworker.0 00000100:00100000:0.0:1787857156.948416:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857156.948452:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885064960:0@lo:400:kworker.0 00000100:00100000:0.0:1787857156.948479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857156.948618:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064448 00000100:00100000:2.0:1787857156.948624:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064448 00000100:00100000:2.0:1787857156.948686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787857156.948694:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885064448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857156.948742:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885064448:12345-0@lo:400:kworker.0 Request processed in 50us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857156.948749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787857156.949338:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064960 00000100:00100000:3.0:1787857156.949344:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064960 00000100:00100000:3.0:1787857156.949412:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787857156.949421:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885064960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857156.949465:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885064960:12345-0@lo:400:kworker.0 Request processed in 46us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857156.949472:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787857156.949509:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857156.951329:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885064448:0@lo:400:kworker.0 00000100:00100000:0.0:1787857156.951346:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885064960:0@lo:400:kworker.0 00000100:00100000:1.0:1787857156.953926:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857156.953989:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885064832:0@lo:400:kworker.0 00000100:00100000:1.0:1787857156.954024:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857156.954139:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064320 00000100:00100000:2.0:1787857156.954148:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064320 00000100:00100000:2.0:1787857156.954205:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787857156.954215:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874703885064320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857156.954257:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857156.954329:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874703885064320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857156.954336:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787857156.954569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885064832 00000100:00100000:0.0:1787857156.954574:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885064832 00000100:00100000:0.0:1787857156.954629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787857156.954637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885064832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857156.954689:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885064832:12345-0@lo:400:kworker.0 Request processed in 54us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857156.954709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1787857156.954775:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857156.955634:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885064320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857156.955651:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885064832:0@lo:400:kworker.0 00010000:00010000:0.0:1787857157.576058:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857157.959911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857157.960024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857157.960250:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065088 00000100:00100000:1.0:1787857157.960258:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065088 00000100:00100000:1.0:1787857157.960399:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787857157.960409:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885065088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857157.960444:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857157.960542:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885065088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857157.960580:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787857157.960676:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd947e7b480 x1874703885065088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857157.960695:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857158.600800:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857159.054760:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1787857159.623865:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857160.544548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857160.544594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857160.544637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857160.544745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857160.544780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012224 00000100:00100000:3.0:1787857160.544789:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012224 00000100:00100000:3.0:1787857160.544848:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012480 00000100:00100000:3.0:1787857160.544851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012480 00000100:00100000:3.0:1787857160.544878:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1787857160.544888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863012224:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857160.544963:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863012224:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857160.544971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1787857160.544998:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:3.0:1787857160.545006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863012480:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857160.545047:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863012480:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857160.545053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:2.0:1787857160.545475:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012096 00000100:00100000:2.0:1787857160.545486:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012096 00000100:00100000:2.0:1787857160.545521:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 273 00000100:00100000:2.0:1787857160.545528:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863012096:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857160.545561:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863012096:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 35us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857160.545568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 273 00000100:00080000:2.0:1787857160.545596:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857160.546075:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012352 00000100:00100000:0.0:1787857160.546081:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012352 00000100:00100000:0.0:1787857160.546137:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:0.0:1787857160.546148:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863012352:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857160.546196:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863012352:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 52us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857160.546202:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00080000:2.0:1787857160.546260:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787857160.650134:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857161.671814:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857162.056062:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885065344:0@lo:400:kworker.0 00000100:00100000:3.0:1787857162.056134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857162.056649:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885065216:0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.056705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857162.056732:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885065728:0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.056754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857162.056806:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065600:0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.056833:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857162.056852:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857162.056859:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885065472:0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.056879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857162.056916:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065600 00000100:00100000:1.0:1787857162.056924:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065600 00000100:00100000:1.0:1787857162.056986:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787857162.056996:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.057048:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885065600:12345-0@lo:400:kworker.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857162.057054:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787857162.057075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065344 00000100:00100000:1.0:1787857162.057078:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065344 00000100:00100000:1.0:1787857162.057096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065728 00000100:00100000:1.0:1787857162.057098:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065728 00000100:00100000:1.0:1787857162.057111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065472 00000100:00100000:1.0:1787857162.057113:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065472 00000100:00100000:1.0:1787857162.057123:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787857162.057128:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.057168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885065344:12345-0@lo:400:kworker.0 Request processed in 39us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857162.057173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787857162.057183:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787857162.057187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885065728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.057214:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885065728:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857162.057218:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787857162.057227:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787857162.057232:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.057253:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885065472:12345-0@lo:400:kworker.0 Request processed in 22us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857162.057258:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787857162.057290:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885065472:0@lo:400:kworker.0 00010000:00080000:1.0:1787857162.057301:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd975a443c0 x1874703885065600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857162.057309:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065600:0@lo:400:kworker.0 00000100:00100000:1.0:1787857162.057334:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885065728:0@lo:400:kworker.0 00000100:00100000:2.0:1787857162.058452:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065216 00000100:00100000:2.0:1787857162.058461:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065216 00000100:00100000:2.0:1787857162.058525:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787857162.058534:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885065216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857162.058598:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885065216:12345-0@lo:400:kworker.0 Request processed in 66us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857162.058605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:2.0:1787857162.058634:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857162.058639:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857162.059004:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885065216:0@lo:400:kworker.0 00000100:00100000:0.0:1787857162.059982:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857162.059997:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857162.060043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857162.060081:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065984 00000100:00100000:0.0:1787857162.060085:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065984 00000100:00100000:3.0:1787857162.060568:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885065856:0@lo:400:kworker.0 00000100:00100000:0.0:1787857162.060607:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787857162.060611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857162.060621:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885065984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857162.060653:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885065344:0@lo:400:kworker.0 00002000:00000024:0.0:1787857162.060655:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857162.060698:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885065856 00000100:00100000:3.0:1787857162.060703:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885065856 00000100:00100000:0.0:1787857162.060724:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874703885065984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857162.060736:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857162.060736:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787857162.060746:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874703885065856:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787857162.060763:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857162.060783:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00100000:3.0:1787857162.060789:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885065856:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc 0/0 00000004:00080000:0.0:1787857162.060790:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd947e79a40, transno 4294967300 00000100:00100000:3.0:1787857162.060800:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857162.060812:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885065984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857162.060837:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885065856:0@lo:400:kworker.0 00010000:00010000:2.0:1787857162.700791:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857163.085891:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885066112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857163.086023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857163.086835:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066112 00000100:00100000:2.0:1787857163.086854:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066112 00000100:00100000:2.0:1787857163.086934:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787857163.086960:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885066112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857163.087014:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857163.090120:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885066112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3153us (4087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857163.090136:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787857163.090244:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd947e79a40 x1874703885066112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857163.090270:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885066112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857163.722994:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857164.743887:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857165.666105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857165.666162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857165.666456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012608 00000100:00100000:2.0:1787857165.666559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857165.666616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857165.666650:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012736 00000100:00100000:2.0:1787857165.666690:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012736 00000100:00100000:2.0:1787857165.666751:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012992 00000100:00100000:2.0:1787857165.666755:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012992 00000100:00100000:2.0:1787857165.666780:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:2.0:1787857165.666789:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863012736:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857165.666951:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863012736:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 162us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857165.666960:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:2.0:1787857165.666978:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:2.0:1787857165.666985:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863012992:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857165.667010:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863012992:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857165.667017:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00080000:0.0:1787857165.667050:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857165.667217:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863012864 00000100:00100000:1.0:1787857165.667226:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012864 00000100:00100000:1.0:1787857165.667297:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:1.0:1787857165.667308:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863012864:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857165.667376:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863012864:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 71us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857165.667414:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00080000:0.0:1787857165.667576:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787857165.667971:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863012608 00000100:00100000:3.0:1787857165.668015:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 275 00000100:00100000:3.0:1787857165.668024:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863012608:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857165.668133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863012608:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 53us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857165.668142:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 275 00010000:00010000:0.0:1787857165.767927:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857166.472579:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787857166.792319:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857167.176220:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885066240:0@lo:400:kworker.0 00000100:00100000:1.0:1787857167.176297:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857167.176562:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885066368:0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.176600:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857167.176705:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066240 00000100:00100000:0.0:1787857167.176722:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885066496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857167.176726:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066240 00000100:00100000:0.0:1787857167.176757:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857167.176782:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787857167.176793:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885066240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.176800:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066496 00000100:00100000:0.0:1787857167.176805:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066496 00000100:00100000:0.0:1787857167.176847:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787857167.176854:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885066496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857167.176895:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857167.176937:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885066496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857167.176945:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787857167.176969:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857167.177009:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9759d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885066496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857167.177023:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885066624:0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.177058:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885066880:0@lo:400:kworker.0 00000100:00100000:2.0:1787857167.177059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857167.177510:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066368 00000100:00100000:2.0:1787857167.177515:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066368 00000100:00100000:2.0:1787857167.177554:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066624 00000100:00100000:2.0:1787857167.177557:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066624 00000100:00100000:2.0:1787857167.177584:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787857167.177591:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885066368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.178301:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787857167.178323:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857167.178346:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857167.178347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066880 00000100:00100000:1.0:1787857167.178353:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066880 00000100:00100000:0.0:1787857167.178358:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885066752:0@lo:400:kworker.0 00000100:00100000:1.0:1787857167.178385:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787857167.178394:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885066624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.178409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857167.178447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885066624:12345-0@lo:400:kworker.0 Request processed in 54us (1389us total) trans 0 rc 0/0 00000100:00080000:0.0:1787857167.178454:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857167.178455:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787857167.178476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787857167.178484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885066880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.178494:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885066624:0@lo:400:kworker.0 00000100:00100000:0.0:1787857167.178531:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885066880:0@lo:400:kworker.0 00000100:00100000:1.0:1787857167.178538:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885066880:12345-0@lo:400:kworker.0 Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857167.178546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787857167.178577:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885066752 00000100:00100000:1.0:1787857167.178581:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885066752 00000100:00100000:1.0:1787857167.178620:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787857167.178627:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857167.178683:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885066752:12345-0@lo:400:kworker.0 Request processed in 58us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857167.178690:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787857167.178706:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787857167.178744:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a4bcf00 x1874703885066752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857167.178764:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885066752:0@lo:400:kworker.0 00000100:00100000:2.0:1787857167.179101:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885066368:12345-0@lo:400:kworker.0 Request processed in 1509us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857167.179114:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787857167.179185:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885066368:0@lo:400:kworker.0 00000100:00100000:1.0:1787857167.179463:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885066240:0@lo:400:kworker.0 00000100:00100000:3.0:1787857167.179510:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885066240:12345-0@lo:400:kworker.0 Request processed in 2719us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857167.179519:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00010000:2.0:1787857167.816931:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857168.199913:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885067008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857168.199991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857168.200023:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067008 00000100:00100000:2.0:1787857168.200033:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067008 00000100:00100000:2.0:1787857168.200093:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787857168.200102:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885067008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857168.200135:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857168.200187:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885067008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857168.200193:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787857168.200322:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd947e79a40 x1874703885067008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857168.200341:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885067008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857168.839965:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857169.864567:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857170.787896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857170.787957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857170.788157:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013248 00000100:00100000:1.0:1787857170.788167:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013248 00000100:00100000:1.0:1787857170.788251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:1.0:1787857170.788264:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863013248:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857170.788346:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863013248:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 85us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857170.788418:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00080000:0.0:1787857170.788748:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857170.788826:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013120 00000100:00100000:3.0:1787857170.788831:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013120 00000100:00100000:3.0:1787857170.788872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 277 00000100:00100000:3.0:1787857170.788879:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863013120:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857170.788917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863013120:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 39us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857170.788924:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 277 00000100:00100000:2.0:1787857170.800301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857170.800734:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013376 00000100:00100000:1.0:1787857170.800745:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013376 00000100:00100000:1.0:1787857170.800842:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1787857170.800853:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2351:x1874703863013376:12345-192.168.204.29@tcp:9:kworker.0 00000020:00000080:1.0:1787857170.800884:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe969 00000100:00080000:1.0:1787857170.800893:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd9756de000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787857170.800935:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787857170.801271:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+2:2351:x1874703863013376:12345-192.168.204.29@tcp:9:kworker.0 Request processed in 419us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857170.801279:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:1.0:1787857170.801306:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857170.801536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857170.801565:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013504 00000100:00100000:3.0:1787857170.801572:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013504 00000100:00100000:3.0:1787857170.801620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:3.0:1787857170.801629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2355:x1874703863013504:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857170.801699:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2355:x1874703863013504:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857170.801706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00080000:0.0:1787857170.801752:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857170.801758:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857170.888054:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857171.912055:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857172.296190:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885067136:0@lo:400:kworker.0 00000100:00100000:3.0:1787857172.296312:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857172.296398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067136 00000100:00100000:3.0:1787857172.296406:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067136 00000100:00100000:3.0:1787857172.296461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787857172.296470:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857172.296546:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885067136:12345-0@lo:400:kworker.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857172.296556:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787857172.296557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885067264:0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.296603:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857172.296629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885067136:0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.296652:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857172.296727:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067264 00000100:00100000:3.0:1787857172.296731:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067264 00000100:00100000:1.0:1787857172.299076:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885067392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857172.299157:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857172.299235:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067392 00000100:00100000:1.0:1787857172.299243:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067392 00000100:00100000:1.0:1787857172.299304:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787857172.299313:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885067392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857172.299351:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857172.299398:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a44b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885067392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857172.299405:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787857172.299425:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857172.299461:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885067392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857172.300247:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787857172.300262:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885067264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857172.300316:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885067264:12345-0@lo:400:kworker.0 Request processed in 60us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857172.300323:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787857172.300591:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885067264:0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.302916:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885067776:0@lo:400:kworker.0 00000100:00100000:0.0:1787857172.302916:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885067520:0@lo:400:kworker.0 00000100:00100000:2.0:1787857172.303004:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885067648:0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.303288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857172.303393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067776 00000100:00100000:3.0:1787857172.303400:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067776 00000100:00100000:3.0:1787857172.303461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787857172.303469:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857172.303587:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885067776:12345-0@lo:400:kworker.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857172.303595:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787857172.303685:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857172.303714:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885067776:0@lo:400:kworker.0 00000100:00100000:0.0:1787857172.303747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857172.303869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857172.303990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067520 00000100:00100000:3.0:1787857172.303995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067520 00000100:00100000:3.0:1787857172.304092:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787857172.304098:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885067520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857172.304135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885067520:12345-0@lo:400:kworker.0 Request processed in 37us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857172.304141:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787857172.304374:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067648 00000100:00100000:0.0:1787857172.304376:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885067520:0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.304380:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067648 00000100:00080000:2.0:1787857172.309870:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857172.309883:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857172.311408:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857172.311424:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857172.311891:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885067648:12345-0@lo:400:kworker.0 Request processed in 472us (8021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857172.311902:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787857172.312128:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd96ddd7c00 x1874703885067648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857172.312162:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885067648:0@lo:400:kworker.0 00010000:00010000:0.0:1787857172.940040:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857173.321227:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857173.321281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885067904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857173.321364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857173.321499:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885067904 00000100:00100000:0.0:1787857173.321507:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885067904 00000100:00100000:0.0:1787857173.321566:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787857173.321577:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885067904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857173.321631:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857173.321728:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885067904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857173.321735:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787857173.321819:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd947e79a40 x1874703885067904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857173.321838:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885067904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787857173.962983:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787857174.438315:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:1.0:1787857174.438325:0:7626:0:(genops.c:885:class_export_put()) final put ffff9fd9756dc000/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857174.438590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9756dc000/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-OST0001 00000020:00000080:2.0:1787857174.438693:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9756de000 for lustre-OST0001 00010000:00010000:1.0:1787857174.984889:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857175.905134:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857175.905184:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857175.905216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857175.905244:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013888 00000100:00100000:3.0:1787857175.905253:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013888 00000100:00100000:3.0:1787857175.905308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013760 00000100:00100000:3.0:1787857175.905312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013760 00000100:00100000:3.0:1787857175.905337:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1787857175.905347:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863013888:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857175.905425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863013888:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857175.905434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1787857175.905452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:3.0:1787857175.905460:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863013760:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857175.905484:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863013760:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857175.905489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00080000:3.0:1787857175.905509:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857175.905765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863013632 00000100:00100000:0.0:1787857175.905770:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863013632 00000100:00100000:0.0:1787857175.905815:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 279 00000100:00100000:0.0:1787857175.905823:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863013632:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857175.905877:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863013632:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 54us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857175.905884:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 279 00010000:00010000:2.0:1787857176.007852:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857176.712413:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787857177.036411:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857177.416777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885068032:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.416824:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885068160:0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.416858:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857177.416867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857177.416918:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885068544:0@lo:400:kworker.0 00000100:00100000:2.0:1787857177.417002:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885068288:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417053:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885068672:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857177.417112:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885068416:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857177.417170:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068160 00000100:00100000:1.0:1787857177.417178:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068160 00000100:00100000:1.0:1787857177.417234:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787857177.417243:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885068160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417292:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885068160:12345-0@lo:400:kworker.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857177.417453:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787857177.417478:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068672 00000100:00100000:1.0:1787857177.417488:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068672 00000100:00100000:1.0:1787857177.417521:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068416 00000100:00100000:1.0:1787857177.417524:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068416 00000100:00100000:1.0:1787857177.417542:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787857177.417548:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417581:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885068672:12345-0@lo:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857177.417587:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787857177.417599:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787857177.417605:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885068416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417633:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885068416:12345-0@lo:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857177.417638:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787857177.417698:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857177.417702:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787857177.417731:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd94a639680 x1874703885068416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787857193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857177.417746:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a639680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885068416:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417775:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885068160:0@lo:400:kworker.0 00000100:00100000:1.0:1787857177.417783:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885068672:0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.420386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857177.420475:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068032 00000100:00100000:0.0:1787857177.420485:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068032 00000100:00100000:0.0:1787857177.420727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787857177.420737:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.420797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885068032:12345-0@lo:400:kworker.0 Request processed in 62us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857177.420804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787857177.420844:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068544 00000100:00100000:0.0:1787857177.420849:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068544 00000100:00100000:0.0:1787857177.420887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787857177.420895:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885068544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.420929:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885068544:12345-0@lo:400:kworker.0 Request processed in 36us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857177.420935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787857177.421270:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885068544:0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.421282:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885068032:0@lo:400:kworker.0 00000100:00080000:1.0:1787857177.422488:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857177.424936:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857177.425164:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885068800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857177.425184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068288 00000100:00100000:0.0:1787857177.425200:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068288 00000100:00100000:2.0:1787857177.425422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857177.425466:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068800 00000100:00100000:2.0:1787857177.425470:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068800 00000100:00100000:2.0:1787857177.425514:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787857177.425523:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885068800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857177.425560:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857177.425604:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885068800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857177.425611:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787857177.426522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787857177.426534:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885068288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857177.426587:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885068288:12345-0@lo:400:kworker.0 Request processed in 57us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857177.426593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787857177.426924:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885068800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857177.426962:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a63a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885068288:0@lo:400:kworker.0 00000100:00080000:1.0:1787857177.430205:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787857177.729412:0:11840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:59:35 (1787857175) 00010000:00010000:3.0:1787857178.064215:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857178.440203:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885068928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857178.440960:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857178.441084:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885068928 00000100:00100000:0.0:1787857178.441093:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885068928 00000100:00100000:0.0:1787857178.441180:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857178.441191:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885068928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857178.441235:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857178.441315:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885068928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857178.441323:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787857178.441393:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd9602e30c0 x1874703885068928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857178.441412:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885068928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857179.079885:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857179.634416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857179.638695:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014016 00000100:00100000:1.0:1787857179.638712:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014016 00000100:00100000:1.0:1787857179.638810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:1.0:1787857179.638825:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:10227:x1874703863014016:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857179.638846:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857179.638910:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbea34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88283a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.638984:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.638997:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.639009:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857179.639209:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857179.639213:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857179.639308:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.639336:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbea34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88283a expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.639355:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88283a expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857179.639373:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fc00) 00010000:00010000:1.0:1787857179.639376:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857179.639380:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489600, rc 0) 00000100:00100000:1.0:1787857179.639449:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:10227:x1874703863014016:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 630us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857179.639456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00080000:3.0:1787857179.640572:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857179.645763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857179.646649:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014144 00000100:00100000:3.0:1787857179.646693:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014144 00000100:00100000:3.0:1787857179.646762:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:3.0:1787857179.646788:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:10228:x1874703863014144:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857179.646809:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857179.646829:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882841 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646891:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646907:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646918:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646946:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646953:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.646960:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.647383:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.647393:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857179.647401:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857179.647500:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787857179.647504:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857179.656241:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656266:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656274:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656282:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656299:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857179.656304:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656312:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656329:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fc00) 00010000:00010000:2.0:1787857179.656332:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857179.656336:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656341:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbea49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656357:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656364:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656369:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656374:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857179.656377:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656383:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656401:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fd946159900) 00010000:00010000:2.0:1787857179.656404:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857179.656406:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656411:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656451:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882841 expref: 8 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656464:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882841 expref: 7 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857179.656471:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd946159700) 00010000:00010000:2.0:1787857179.656473:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857179.656475:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045400, rc 0) 00000100:00100000:2.0:1787857179.657188:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:10228:x1874703863014144:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 10400us (11431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857179.657198:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857179.681179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857179.681690:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014400 00000100:00100000:0.0:1787857179.681701:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014400 00000100:00100000:0.0:1787857179.681764:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1787857179.681776:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:10228:x1874703863014400:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857179.681798:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857179.681818:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbea5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882848 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.681892:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.681908:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.681951:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.682020:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.682029:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.682036:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683075:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560200/0xf326646fe3bbea73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683090:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560200/0xf326646fe3bbea73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683098:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560200/0xf326646fe3bbea73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857179.683108:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787857179.683332:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683340:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683347:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683353:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857179.683364:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683373:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683386:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd946159700) 00010000:00010000:0.0:1787857179.683389:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857179.683394:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683401:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbea65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683414:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683420:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683426:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683431:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857179.683434:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683440:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683447:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fd953423f00) 00010000:00010000:0.0:1787857179.683450:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857179.683459:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.683464:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbea6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.685829:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbea5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882848 expref: 10 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.685860:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560200/0xf326646fe3bbea73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882848 expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857179.685869:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:0.0:1787857179.685872:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857179.685875:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560200, rc 0) 00000100:00100000:0.0:1787857179.685982:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10228:x1874703863014400:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 4207us (4812us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787857179.685994:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:3.0:1787857179.697707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857179.698547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014528 00000100:00100000:0.0:1787857179.698561:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014528 00000100:00100000:0.0:1787857179.698645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1787857179.698656:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10228:x1874703863014528:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787857179.698800:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10228:x1874703863014528:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 146us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857179.698808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000040:00080000:0.0:1787857179.784658:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787857180.110475:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857181.028630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857181.028712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857181.028741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857181.028767:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014656 00000100:00100000:2.0:1787857181.028775:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014656 00000100:00100000:2.0:1787857181.028821:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 281 00000100:00100000:2.0:1787857181.028831:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863014656:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857181.028908:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863014656:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857181.028915:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 281 00000100:00100000:1.0:1787857181.030475:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014784 00000100:00100000:1.0:1787857181.030486:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014784 00000100:00100000:1.0:1787857181.030543:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863014912 00000100:00100000:1.0:1787857181.030547:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863014912 00000100:00100000:1.0:1787857181.030573:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:1.0:1787857181.030582:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863014784:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857181.030656:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863014784:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 75us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857181.030679:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:1.0:1787857181.030694:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1787857181.030700:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863014912:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857181.030723:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863014912:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857181.030729:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00080000:0.0:1787857181.031957:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857181.129139:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857181.966189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857181.966462:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015040 00000100:00100000:3.0:1787857181.966472:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015040 00000100:00100000:3.0:1787857181.966534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:3.0:1787857181.966545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10270:x1874703863015040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857181.966564:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857181.966617:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88284f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966706:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966720:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966733:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966746:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966753:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.966760:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967102:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967110:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967115:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967326:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857181.967331:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967339:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967353:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fc00) 00010000:00010000:3.0:1787857181.967356:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857181.967360:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbea88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967379:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967384:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967390:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967401:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857181.967404:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967411:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967420:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fd946159000) 00010000:00010000:3.0:1787857181.967423:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857181.967425:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967463:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88284f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967474:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fc00) 00010000:00010000:3.0:1787857181.967477:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857181.967481:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88284f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.967490:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045e00, rc 0) 00000100:00100000:3.0:1787857181.967552:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10270:x1874703863015040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1008us (1372us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857181.967560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:1.0:1787857181.984103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857181.985276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015296 00000100:00100000:3.0:1787857181.985301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015296 00000100:00100000:3.0:1787857181.985366:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1787857181.985376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10270:x1874703863015296:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1787857181.985431:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857181.985459:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbea3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88283a expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985477:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd963a5fc00) 00010000:00010000:3.0:1787857181.985486:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857181.985797:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985811:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985820:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985833:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985841:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.985847:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857181.989516:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787857181.989536:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.989546:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.989561:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.989568:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857181.990017:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.990029:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.990047:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159000) 00010000:00010000:3.0:1787857181.990051:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857181.990056:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857181.990063:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbea96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857181.990083:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a2da48d reply state 0000000027018138 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857181.990092:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857181.991437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:10270:x1874703863015296:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 6055us (7336us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787857181.991448:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00010000:00010000:3.0:1787857182.009697:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009718:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009736:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009743:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857182.009747:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009755:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009774:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fd946159c00) 00010000:00010000:3.0:1787857182.009777:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857182.009782:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.009789:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbea9d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.157873:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857182.167367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.171144:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015424 00000100:00100000:0.0:1787857182.171158:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015424 00000100:00100000:0.0:1787857182.171218:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1787857182.171226:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10278:x1874703863015424:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:0.0:1787857182.171256:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857182.171277:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeaa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882856 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171336:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171348:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171359:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857182.171412:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787857182.171415:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857182.171453:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171476:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882856 expref: 11 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171492:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882856 expref: 10 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.171500:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:0.0:1787857182.171503:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857182.171514:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857182.171585:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:10278:x1874703863015424:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 359us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857182.171592:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:0.0:1787857182.243309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.243408:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015552 00000100:00100000:2.0:1787857182.243417:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015552 00000100:00100000:2.0:1787857182.243472:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:2.0:1787857182.243482:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:10284:x1874703863015552:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857182.243500:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857182.243518:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbeab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88285d expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243585:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243597:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243607:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243619:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243625:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243632:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243777:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243786:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243792:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857182.243818:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787857182.243822:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857182.243858:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243869:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243885:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243892:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243897:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341ac00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857182.243909:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243918:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243928:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:2.0:1787857182.243936:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857182.243941:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243948:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ac00/0xf326646fe3bbeab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243962:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243967:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243973:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243979:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341b400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857182.243982:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243988:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.243996:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fd949362600) 00010000:00010000:2.0:1787857182.243999:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857182.244001:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.244006:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341b400/0xf326646fe3bbeac0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.244034:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341be00/0xf326646fe3bbeab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88285d expref: 12 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.244061:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88285d expref: 11 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.244069:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857182.244071:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857182.244073:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd95341ae00, rc 0) 00000100:00100000:2.0:1787857182.244139:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10284:x1874703863015552:12345-192.168.204.29@tcp:101:bash.0 Request processed in 659us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.244147:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1787857182.247552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857182.247644:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015808 00000100:00100000:3.0:1787857182.247652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015808 00000100:00100000:3.0:1787857182.247772:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:3.0:1787857182.247782:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10284:x1874703863015808:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1787857182.247801:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857182.247819:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbeace lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882864 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.247970:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248002:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248012:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248047:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248055:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248062:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787857182.248579:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787857182.248776:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248786:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248793:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248826:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248833:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248839:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248852:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857182.248857:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248863:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248875:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857182.248877:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857182.248881:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbead5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857182.248899:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebf0e542 reply state 00000000665ca050 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857182.248907:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857182.248934:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbeace lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248948:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.248955:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:3.0:1787857182.248958:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857182.248960:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857182.249026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10284:x1874703863015808:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1245us (1482us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787857182.249039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00010000:00010000:2.0:1787857182.253301:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253319:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253326:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253333:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857182.253337:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253345:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253362:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd946159c00) 00010000:00010000:2.0:1787857182.253365:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857182.253369:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.253390:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbeadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857182.253949:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857182.254089:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863015936 00000100:00100000:1.0:1787857182.254105:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863015936 00000100:00100000:1.0:1787857182.254141:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1787857182.254150:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863015936:12345-192.168.204.29@tcp:8:bash.0 00010000:00080000:1.0:1787857182.254181:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:1.0:1787857182.254219:0:6678:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbeaf1 00002000:00100000:1.0:1787857182.254231:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1/ffff9fd95051a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787857182.254254:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787857182.254465:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787857182.254493:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd95051f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857182.254559:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703863015936:12345-192.168.204.29@tcp:8:bash.0 Request processed in 408us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857182.254577:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1787857182.268717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.268805:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863016064 00000100:00100000:2.0:1787857182.268813:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863016064 00000100:00100000:2.0:1787857182.268872:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857182.268889:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:0:x1874703863016064:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857182.268911:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857182.268932:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88286b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857182.268963:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857182.268981:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1787857182.268986:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857182.268995:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.269014:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.269029:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84200, rc 0) 00000100:00100000:2.0:1787857182.269085:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:0:x1874703863016064:12345-192.168.204.29@tcp:101:bash.0 Request processed in 197us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.269092:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00080000:0.0:1787857182.269696:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857182.273091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.273283:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863016192 00000100:00100000:2.0:1787857182.273292:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863016192 00000100:00100000:2.0:1787857182.273398:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1787857182.273407:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:10284:x1874703863016192:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857182.273423:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857182.273440:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882872 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.273467:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.273476:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857182.273480:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857182.273486:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.273520:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.273534:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.273550:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874703885069056:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857182.273649:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946571600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857182.282730:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874703885069056:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857182.282764:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.282804:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85a00, rc 0) 00000100:00100000:2.0:1787857182.282866:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:10284:x1874703863016192:12345-192.168.204.29@tcp:101:bash.0 Request processed in 9459us (9783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.282884:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1787857182.283853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.284045:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863016320 00000100:00100000:2.0:1787857182.284052:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863016320 00010000:00010000:2.0:1787857182.284083:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.284151:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1787857182.284161:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863016320:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857182.284174:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857182.284196:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.284219:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.284242:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a75ac0/0xf326646fe3bbeaf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88286b expref: 8 pid: 6679 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.284256:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857182.284261:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857182.284268:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.284288:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.284320:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.284333:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885069184:192.168.204.29@tcp:105: 00000100:00100000:2.0:1787857182.284397:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946571600 going to sleep for 11 seconds 00000100:00100000:1.0:1787857182.290412:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.290516:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885069184:192.168.204.29@tcp:105: 00010000:00010000:2.0:1787857182.290541:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857182.290606:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863016320:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6445us (6754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.290618:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1787857182.290824:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863016576 00000100:00100000:0.0:1787857182.290830:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863016576 00000100:00100000:0.0:1787857182.290880:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1787857182.290888:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10284:x1874703863016576:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:0.0:1787857182.291343:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10284:x1874703863016576:12345-192.168.204.29@tcp:35:bash.0 Request processed in 455us (941us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787857182.291350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1787857182.403854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.404142:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863016832 00000100:00100000:0.0:1787857182.404151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863016832 00000100:00100000:0.0:1787857182.404223:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:0.0:1787857182.404233:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10294:x1874703863016832:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857182.404258:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857182.404277:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbeb06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882879 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857182.404381:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787857182.404500:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbeb06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882879 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.404531:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:0.0:1787857182.404535:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857182.404541:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbeb06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882879 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.404574:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857182.404637:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10294:x1874703863016832:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 405us (793us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787857182.404643:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:1.0:1787857182.412836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.413051:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017088 00000100:00100000:0.0:1787857182.413060:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017088 00000100:00100000:0.0:1787857182.413116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1787857182.413125:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10294:x1874703863017088:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857182.413376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10294:x1874703863017088:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 251us (549us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787857182.413384:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857182.536224:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857182.536245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885069312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857182.536311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857182.536627:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885069568:0@lo:400:kworker.0 00000100:00100000:0.0:1787857182.536683:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857182.536706:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857182.536712:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885069696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857182.536735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857182.536764:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069568 00000100:00100000:0.0:1787857182.536771:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069568 00000100:00100000:0.0:1787857182.536811:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069696 00000100:00100000:0.0:1787857182.536814:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069696 00000100:00100000:0.0:1787857182.536852:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787857182.536860:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885069568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857182.536908:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885069568:12345-0@lo:400:kworker.0 Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857182.536915:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787857182.537270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885069824:0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857182.537329:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787857182.537335:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885069440:0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857182.537380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885069952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537400:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857182.537424:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069312 00000100:00100000:2.0:1787857182.537427:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069312 00000100:00100000:2.0:1787857182.537458:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787857182.537466:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885069312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857182.537503:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857182.537537:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885069312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.537544:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787857182.537631:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069440 00000100:00100000:2.0:1787857182.537635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069440 00000100:00100000:2.0:1787857182.537684:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787857182.537692:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885069440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537726:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885069440:12345-0@lo:400:kworker.0 Request processed in 36us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.537733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787857182.537782:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885069440:0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537807:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069824 00000100:00100000:2.0:1787857182.537810:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069824 00000100:00100000:2.0:1787857182.537839:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787857182.537845:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537880:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885069824:12345-0@lo:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.537886:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787857182.537914:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885069824:0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.537944:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885069952 00000100:00100000:2.0:1787857182.537947:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885069952 00000100:00100000:0.0:1787857182.537998:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787857182.538009:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885069696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857182.538042:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885069696:12345-0@lo:400:kworker.0 Request processed in 36us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857182.541290:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885069312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857182.541384:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885069696:0@lo:400:kworker.0 00000100:00100000:1.0:1787857182.541396:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885069568:0@lo:400:kworker.0 00000100:00080000:1.0:1787857182.542656:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857182.542689:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857182.542693:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857182.551361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857182.551393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017216 00000100:00100000:3.0:1787857182.551402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017216 00000100:00100000:3.0:1787857182.551446:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1787857182.551455:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10300:x1874703863017216:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857182.551479:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857182.551499:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbeb14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882880 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551588:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551603:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551614:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857182.551686:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787857182.551690:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857182.551715:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551742:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbeb14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882880 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551760:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882880 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.551784:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857182.551787:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857182.551790:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045e00, rc 0) 00000100:00100000:3.0:1787857182.551840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10300:x1874703863017216:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 387us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857182.551848:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1787857182.554502:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787857182.554519:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857182.554621:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885069952:12345-0@lo:400:kworker.0 Request processed in 107us (17218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.554636:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787857182.554699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885069952:0@lo:400:kworker.0 00000100:00100000:3.0:1787857182.557157:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.557210:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017472 00000100:00100000:2.0:1787857182.557221:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017472 00000100:00100000:2.0:1787857182.557280:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1787857182.557290:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10300:x1874703863017472:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857182.557310:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857182.557329:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbeb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882887 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.557425:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.557439:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.557449:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857182.557459:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787857182.557604:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbeb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882887 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.557623:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882887 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.557632:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:2.0:1787857182.557635:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857182.557651:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84a00, rc 0) 00000100:00100000:2.0:1787857182.557724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10300:x1874703863017472:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 435us (574us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787857182.557733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1787857182.557874:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787857182.560413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.560505:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017728 00000100:00100000:0.0:1787857182.560518:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017728 00000100:00100000:0.0:1787857182.560579:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1787857182.560588:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975487c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10300:x1874703863017728:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857182.560607:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857182.560624:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbeb37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88288e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.560721:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.560734:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.560744:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857182.560756:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787857182.561057:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbeb37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88288e expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.561076:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88288e expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.561084:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:0.0:1787857182.561087:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857182.561090:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560c00, rc 0) 00000100:00100000:0.0:1787857182.561145:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975487c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10300:x1874703863017728:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 557us (737us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787857182.561153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1787857182.562365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857182.564479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857182.564514:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017984 00000100:00100000:3.0:1787857182.564522:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017984 00000100:00100000:2.0:1787857182.564522:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863017856 00000100:00100000:2.0:1787857182.564529:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863017856 00000100:00100000:3.0:1787857182.564582:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:2.0:1787857182.564589:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857182.564595:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863017984:12345-192.168.204.29@tcp:1:lfs.0 00000100:00100000:2.0:1787857182.564603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:2353:x1874703863017856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857182.564618:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857182.564632:0:8078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.564642:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882887 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.564654:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.564675:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:2.0:1787857182.564682:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857182.564689:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857182.564694:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857182.564699:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.564733:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2353:x1874703863017856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 134us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.564741:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00010000:00010000:3.0:1787857182.564747:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.564762:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 7 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857182.564777:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975484780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885070080:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857182.564834:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948be0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857182.571209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.571364:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863018112 00000100:00100000:0.0:1787857182.571373:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863018112 00002000:00100000:0.0:1787857182.571429:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fd981f74b40 x1874703863018112/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:583/0 lens 504/0 e 0 to 0 dl 1787857193 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857182.571439:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f74b40 with x1874703863018112 ext(0->12) 00010000:00010000:0.0:1787857182.571448:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 8 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.571465:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 8 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857182.571473:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd981f74b40 00000100:00100000:0.0:1787857182.571505:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1787857182.571514:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863018112:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:3.0:1787857182.575283:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975484780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885070080:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857182.575311:0:8078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787857182.652492:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000100:00100000:3.0:1787857182.704800:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863018112:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 133279us (133593us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787857182.704821:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00002000:00100000:3.0:1787857182.704834:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fd981f74b40 x1874703863018112/t4294967299(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:583/0 lens 504/448 e 0 to 0 dl 1787857193 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857182.704844:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f74b40 with x1874703863018112 ext(0->12) 00010000:00010000:3.0:1787857182.704855:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.706718:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857182.706749:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd981f74b40 00000100:00100000:3.0:1787857182.721137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857182.721224:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863018240 00000100:00100000:1.0:1787857182.721233:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863018240 00010000:00010000:1.0:1787857182.721277:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857182.721357:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:1.0:1787857182.721367:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863018240:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857182.721393:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787857182.721411:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787857182.721414:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787857181 00002000:00010000:1.0:1787857182.721417:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787857182 00002000:00010000:1.0:1787857182.721419:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787857181 00010000:00010000:1.0:1787857182.721425:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.721440:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.721465:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e096c8ab/0xf326646fe3bbeaff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882872 expref: 9 pid: 6678 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.721482:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787857182.721486:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857182.721493:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.721522:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.721565:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857182.721616:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863018240:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 250us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857182.721625:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00010000:00010000:0.0:1787857182.721739:0:8078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721755:0:8078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721777:0:8078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721785:0:8078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721792:0:8078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721799:0:8078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857182.721802:0:8078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721811:0:8078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721824:0:8078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.721832:0:8078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001595e326/0xf326646fe3bbeb4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857182.721914:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863017984:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 157323us (157442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857182.721922:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:3.0:1787857182.732154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.732280:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863018496 00000100:00100000:2.0:1787857182.732290:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863018496 00000100:00100000:2.0:1787857182.733026:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1787857182.733038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:10300:x1874703863018496:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:2.0:1787857182.733103:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88288e expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857182.733384:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787857182.733430:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787857182.735142:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787857182.735223:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.735244:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.735253:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.735286:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.735301:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 24 pid: 5837 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.735315:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f743c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874703885070208:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857182.735405:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857182.738451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857182.738852:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863018624 00000100:00100000:3.0:1787857182.738860:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863018624 00010000:00010000:3.0:1787857182.738914:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 25 pid: 5837 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857182.739063:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1787857182.739074:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:2353:x1874703863018624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857182.739090:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857182.739096:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 25 pid: 5837 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.739109:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 25 pid: 5837 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.739131:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:3.0:1787857182.739137:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.739146:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.739152:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857182.739192:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857182.739244:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:2353:x1874703863018624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 173us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857182.739252:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00010000:00010000:2.0:1787857182.741129:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeae3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882864 expref: 24 pid: 5837 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857182.741155:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f743c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874703885070208:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857182.741176:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.741186:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.741192:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857182.741328:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787857182.742128:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787857182.742252:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975484f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885070336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787857182.742340:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857182.742373:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd95137bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857182.742434:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885070336 00000100:00100000:2.0:1787857182.742441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885070336 00000100:00100000:2.0:1787857182.742487:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857182.742495:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874703885070336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857182.742635:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975486940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874703885070336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857182.742642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857182.748841:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975484f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885070336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787857182.749627:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1787857182.751072:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885070464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787857182.751145:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857182.751226:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942fada80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857182.754229:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885070464 00000100:00100000:2.0:1787857182.754241:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885070464 00000100:00100000:2.0:1787857182.754306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857182.754316:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1874703885070464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857182.754612:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1874703885070464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 297us (3466us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787857182.754620:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787857182.754849:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769db480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885070464:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787857182.755049:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787857182.755098:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755108:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755115:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755120:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857182.755125:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755133:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755147:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:1.0:1787857182.755150:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857182.755154:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.755174:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbeb53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857182.755353:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857182.755569:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787857182.755581:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337083920402ns, next at 338083917977ns, rc = 0 00000001:00080000:1.0:1787857182.755587:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787857182.755618:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159000) 00010000:00010000:1.0:1787857182.755621:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857182.755628:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbeb3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88288e expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857182.756155:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10300:x1874703863018496:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 23118us (24007us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787857182.756164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000020:00080000:1.0:1787857182.756169:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787857182.761349:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857182.761418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863018752 00000100:00100000:1.0:1787857182.761426:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863018752 00000100:00100000:1.0:1787857182.761483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1787857182.761493:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10300:x1874703863018752:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857182.761517:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857182.761539:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbeb5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882895 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.761608:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbeb5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882895 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.761641:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbeb5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882895 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857182.761677:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857182.761680:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857182.761684:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953489400, rc 0) 00000100:00100000:1.0:1787857182.772844:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975486580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:10300:x1874703863018752:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 11339us (11491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857182.772858:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:3.0:1787857182.781121:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857182.781217:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863019008 00000100:00100000:1.0:1787857182.781227:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863019008 00000100:00100000:1.0:1787857182.781277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1787857182.781288:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d465c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:10300:x1874703863019008:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1787857182.781520:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d465c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10300:x1874703863019008:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 234us (412us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787857182.781528:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1787857182.933043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.933198:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863019264 00000100:00100000:2.0:1787857182.933208:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863019264 00000100:00100000:2.0:1787857182.933269:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1787857182.933280:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10310:x1874703863019264:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857182.933304:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857182.933323:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbeb61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88289c expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857182.933437:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787857182.933591:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbeb61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88289c expref: 31 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.933626:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:2.0:1787857182.933629:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857182.933634:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbeb61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88289c expref: 31 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857182.933648:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857182.933762:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10310:x1874703863019264:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 484us (740us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787857182.933770:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1787857182.960843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857182.962088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863019392 00000100:00100000:0.0:1787857182.962100:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863019392 00000100:00100000:0.0:1787857182.962165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1787857182.962175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10310:x1874703863019392:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1787857182.962249:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962265:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962276:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962292:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962299:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962317:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962415:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962423:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962431:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857182.962472:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962485:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962491:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962497:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962503:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857182.962507:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962514:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.962526:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857182.962534:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857182.963072:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963083:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbeb6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963098:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963103:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963108:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963113:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857182.963116:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963121:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963130:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd953423200) 00010000:00010000:0.0:1787857182.963132:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857182.963134:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963154:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963167:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963172:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963177:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857182.963179:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963184:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963192:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857182.963194:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857182.963198:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857182.963203:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbeb7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857182.963293:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10310:x1874703863019392:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1118us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857182.963302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1787857182.966845:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857182.970783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863019648 00000100:00100000:2.0:1787857182.970797:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863019648 00000100:00100000:2.0:1787857182.970873:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1787857182.970890:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10310:x1874703863019648:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857182.971154:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:10310:x1874703863019648:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 271us (4317us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787857182.971163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1787857183.048291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857183.048407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863019904 00000100:00100000:1.0:1787857183.048418:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863019904 00000100:00100000:1.0:1787857183.048498:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:1.0:1787857183.048509:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:10313:x1874703863019904:12345-192.168.204.29@tcp:101:lfs.0 00000100:00080000:0.0:1787857183.048638:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787857183.048809:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857183.048832:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbeb84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048906:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048934:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048946:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048963:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048970:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.048977:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049105:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049114:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049121:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857183.049129:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787857183.049228:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049235:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049242:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049254:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857183.049259:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049266:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857183.049281:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857183.049286:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049292:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489600/0xf326646fe3bbeb8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049305:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049312:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049318:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049323:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857183.049326:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049332:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049352:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd963a5f800) 00010000:00010000:1.0:1787857183.049355:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857183.049358:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049363:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489a00/0xf326646fe3bbeb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049406:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488c00/0xf326646fe3bbeb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049420:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.049427:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857183.049430:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857183.049433:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd953488a00, rc 0) 00000100:00100000:1.0:1787857183.049499:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10313:x1874703863019904:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 992us (1219us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787857183.049506:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1787857183.056741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857183.056813:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863020032 00000100:00100000:0.0:1787857183.056823:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863020032 00000100:00100000:0.0:1787857183.056884:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857183.056894:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10313:x1874703863020032:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857183.056988:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057004:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057015:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057042:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057049:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057054:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057061:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857183.057065:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057073:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057084:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857183.057087:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857183.057091:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.057097:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbeba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857183.057188:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10313:x1874703863020032:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 295us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857183.057196:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857183.062191:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857183.063064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863020288 00000100:00100000:2.0:1787857183.063076:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863020288 00000100:00100000:2.0:1787857183.063130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857183.063139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10313:x1874703863020288:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857183.063367:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:10313:x1874703863020288:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 227us (1248us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787857183.063393:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00010000:00010000:1.0:1787857183.175941:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857183.435785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857183.435899:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863020544 00000100:00100000:0.0:1787857183.435910:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863020544 00000100:00100000:0.0:1787857183.435984:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:0.0:1787857183.435996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:10344:x1874703863020544:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1787857183.436023:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857183.436043:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbebae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828aa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.436143:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.436157:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.436169:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857183.436796:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787857183.437333:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbebae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828aa expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.437352:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828aa expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.437371:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857183.437373:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857183.437377:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561e00, rc 0) 00000100:00100000:3.0:1787857183.442080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857183.442319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863020800 00000100:00100000:2.0:1787857183.442329:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863020800 00000100:00100000:2.0:1787857183.442397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1787857183.442408:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:10344:x1874703863020800:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:2.0:1787857183.442768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:10344:x1874703863020800:12345-192.168.204.29@tcp:35:cat.0 Request processed in 360us (696us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787857183.442776:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1787857183.444118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857183.444428:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:10344:x1874703863020544:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1458us (1677us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787857183.444438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:1.0:1787857183.459025:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863020928 00000100:00100000:1.0:1787857183.459039:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863020928 00000100:00100000:1.0:1787857183.459251:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1787857183.459263:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:2353:x1874703863020928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857183.459279:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857183.459320:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828aa expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.459340:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857183.459345:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857183.459418:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:2353:x1874703863020928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 158us (15304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857183.459425:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1787857183.503752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857183.503964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863021184 00000100:00100000:3.0:1787857183.503976:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863021184 00000100:00100000:3.0:1787857183.504043:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:3.0:1787857183.504275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:10350:x1874703863021184:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:3.0:1787857183.504306:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857183.504310:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857183.504346:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeb1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882880 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504371:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857183.504378:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857183.504396:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbebc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504636:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504655:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504749:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504792:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.504806:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 36 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857183.504820:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975485680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885070592:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857183.504921:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd941621f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857183.512705:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975485680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885070592:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857183.512734:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857183.517249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857183.517897:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863021312 00000100:00100000:3.0:1787857183.517908:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863021312 00010000:00010000:3.0:1787857183.517960:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 37 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857183.517992:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:3.0:1787857183.518001:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:2355:x1874703863021312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857183.518016:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857183.518023:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 37 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518057:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 37 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518085:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953488a00/0xf326646fe3bbeb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828a3 expref: 37 pid: 5838 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518104:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:3.0:1787857183.518109:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518118:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518126:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.518171:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857183.518225:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:2355:x1874703863021312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 224us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857183.518233:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00010000:00010000:2.0:1787857183.518274:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.518285:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857183.518304:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787857183.518481:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbebc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.518500:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.518507:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857183.518509:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787857183.518511:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045200, rc 0) 00000100:00100000:2.0:1787857183.518564:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:10350:x1874703863021184:12345-192.168.204.29@tcp:101:dd.0 Request processed in 14502us (14821us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787857183.518572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:2.0:1787857183.529359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857183.529439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863021568 00000100:00100000:3.0:1787857183.529458:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863021568 00000100:00100000:3.0:1787857183.529516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1787857183.529528:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:10350:x1874703863021568:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:3.0:1787857183.529850:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.529867:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857183.529907:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857183.529959:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787857183.529985:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fcdca44 reply state 0000000002df4ad7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857183.529993:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857183.530094:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:10350:x1874703863021568:12345-192.168.204.29@tcp:36:dd.0 Request processed in 567us (743us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787857183.530101:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000020:00080000:3.0:1787857183.530106:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857183.531565:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531579:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531585:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531591:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857183.531595:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531602:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531633:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857183.531636:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857183.531641:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857183.531648:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbebd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857183.559861:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885070720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857183.559939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857183.560048:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885070720 00000100:00100000:1.0:1787857183.560056:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885070720 00000100:00100000:1.0:1787857183.560106:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787857183.560115:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885070720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857183.560135:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857183.560194:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885070720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857183.560201:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787857183.560285:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885070720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857183.773948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857183.774037:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863021696 00000100:00100000:0.0:1787857183.774046:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863021696 00000100:00100000:0.0:1787857183.774108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:0.0:1787857183.774119:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:10364:x1874703863021696:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:0.0:1787857183.774141:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857183.774162:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbebdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828b8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774229:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774254:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774268:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774302:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774469:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774480:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774591:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774603:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774612:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774646:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.774682:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 39 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857183.774696:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ae580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885070848:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857183.774881:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942fad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857183.777493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857183.777772:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ae580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885070848:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857183.777807:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857183.777894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863021952 00000100:00100000:2.0:1787857183.777901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863021952 00000100:00100000:2.0:1787857183.777958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1787857183.777967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:5591:x1874703863021952:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787857183.778708:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:5591:x1874703863021952:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 740us (1220us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787857183.778717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1787857183.784006:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857183.784097:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863022080 00000100:00100000:2.0:1787857183.784106:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863022080 00010000:00010000:2.0:1787857183.784145:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 41 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857183.784182:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:2.0:1787857183.784191:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:2353:x1874703863022080:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857183.784206:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857183.784213:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 41 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784226:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 41 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784252:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbebca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b1 expref: 41 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784269:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857183.784274:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784294:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784303:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.784328:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857183.784368:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784379:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857183.784432:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:2353:x1874703863022080:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 240us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857183.784440:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000004:00200000:0.0:1787857183.784481:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787857183.784487:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857183.784534:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784562:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784572:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784579:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784586:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784592:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857183.784596:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784604:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784616:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857183.784626:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857183.784631:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784637:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbebe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784648:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784654:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784702:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784707:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857183.784711:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784717:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784726:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd953423200) 00010000:00010000:0.0:1787857183.784729:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857183.784732:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784737:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbebed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784777:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbebdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b8 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784871:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b8 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857183.784881:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857183.784884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857183.784886:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560e00, rc 0) 00000100:00100000:0.0:1787857183.784932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975487840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:10364:x1874703863021696:12345-192.168.204.29@tcp:101:stat.0 Request processed in 10814us (10993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857183.784939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:1.0:1787857183.864948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857183.865478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863022336 00000100:00100000:2.0:1787857183.865488:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863022336 00000100:00100000:2.0:1787857183.865555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:2.0:1787857183.865565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:10370:x1874703863022336:12345-192.168.204.29@tcp:36:truncate.0 00010000:00010000:2.0:1787857183.865621:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857183.865690:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbebf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828b8 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.865711:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857183.865716:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857183.865909:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.865924:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.865932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857183.866918:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787857183.867183:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017941ce1 reply state 000000006577e599 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857183.867193:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857183.868828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:10370:x1874703863022336:12345-192.168.204.29@tcp:36:truncate.0 Request processed in 3257us (3883us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787857183.868838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000020:00080000:2.0:1787857183.868844:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787857183.870170:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870183:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870190:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870196:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857183.870200:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870208:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870471:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857183.870475:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857183.870481:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857183.870487:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbebfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857184.026085:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.026974:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863022464 00000100:00100000:2.0:1787857184.026986:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863022464 00000100:00100000:2.0:1787857184.027057:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:2.0:1787857184.027069:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:10384:x1874703863022464:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:2.0:1787857184.027094:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.027228:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828bf expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027296:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027311:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027322:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027337:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027342:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027348:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027447:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027456:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.027479:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857184.027514:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787857184.027518:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857184.028925:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028944:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028954:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028961:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028968:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028974:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.028978:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028986:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.028998:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857184.029002:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857184.029006:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029026:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029042:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029049:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029055:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029060:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.029063:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029069:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029077:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362900) 00010000:00010000:2.0:1787857184.029080:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857184.029083:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.029088:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.030317:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 42 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.030340:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 41 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.030361:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.030364:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857184.030367:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85e00, rc 0) 00000100:00100000:2.0:1787857184.030451:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:10384:x1874703863022464:12345-192.168.204.29@tcp:101:stat.0 Request processed in 3384us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857184.030460:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:3.0:1787857184.144786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.144916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863022720 00000100:00100000:0.0:1787857184.144927:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863022720 00000100:00100000:0.0:1787857184.145001:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:0.0:1787857184.145013:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:10394:x1874703863022720:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857184.145035:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857184.145070:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbec1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828c6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857184.145223:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787857184.145345:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbec1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828c6 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.145360:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:0.0:1787857184.145363:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857184.145368:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbec1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828c6 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.145395:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561000, rc 0) 00000100:00100000:0.0:1787857184.145464:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:10394:x1874703863022720:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 455us (690us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787857184.145472:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1787857184.151596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.151711:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863022976 00000100:00100000:1.0:1787857184.151722:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863022976 00000100:00100000:1.0:1787857184.151829:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:1.0:1787857184.151848:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:10394:x1874703863022976:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1787857184.152142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:10394:x1874703863022976:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 303us (555us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787857184.152151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:2.0:1787857184.199895:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857184.203776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.203938:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863023232 00000100:00100000:2.0:1787857184.203949:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863023232 00000100:00100000:2.0:1787857184.204013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:2.0:1787857184.204024:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:10400:x1874703863023232:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857184.204054:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.204505:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828cd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.204640:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.204655:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 44 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.204690:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.204724:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 44 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.204751:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 44 pid: 8075 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.204765:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885070976:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857184.204868:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857184.211923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.212134:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863023360 00000100:00100000:1.0:1787857184.212144:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863023360 00010000:00010000:1.0:1787857184.212186:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 45 pid: 8075 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857184.212228:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:1.0:1787857184.212238:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:2352:x1874703863023360:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857184.212256:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857184.212263:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 45 pid: 8075 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.212277:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 45 pid: 8075 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.212300:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857184.212306:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.212316:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.212324:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.212344:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857184.212407:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:2352:x1874703863023360:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 170us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857184.212416:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00010000:00010000:2.0:1787857184.212885:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828bf expref: 44 pid: 8075 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.212906:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885070976:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857184.212944:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.212953:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.212959:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857184.212976:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787857184.213140:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.213156:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.213164:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.213182:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787857184.213185:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85200, rc 0) 00000100:00100000:2.0:1787857184.213270:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+44:10400:x1874703863023232:12345-192.168.204.29@tcp:101:bash.0 Request processed in 9248us (9505us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787857184.213278:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:3.0:1787857184.217389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.221263:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863023616 00000100:00100000:2.0:1787857184.221281:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863023616 00000100:00100000:2.0:1787857184.221410:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:2.0:1787857184.221423:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+44:10400:x1874703863023616:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:2.0:1787857184.221754:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.221774:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.221788:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857184.221850:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787857184.221879:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f7d2cc reply state 00000000f586a8f3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.221888:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857184.222021:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10400:x1874703863023616:12345-192.168.204.29@tcp:36:bash.0 Request processed in 600us (4642us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787857184.222030:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000020:00080000:2.0:1787857184.222044:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857184.225490:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225522:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225542:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225548:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857184.225553:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225560:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225577:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857184.225581:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857184.225586:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.225592:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbec41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857184.229040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.231100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863023744 00000100:00100000:2.0:1787857184.231113:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863023744 00000100:00100000:2.0:1787857184.231187:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:2.0:1787857184.231214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:10400:x1874703863023744:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857184.231239:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.231258:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.231339:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.231354:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.231363:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.231396:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.231410:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 47 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.231424:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885071104:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857184.231511:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857184.233754:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f76d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885071104:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857184.233780:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857184.235622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.235856:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863023872 00000100:00100000:2.0:1787857184.235864:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863023872 00010000:00010000:2.0:1787857184.235925:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 48 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.235968:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:2.0:1787857184.235978:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:2353:x1874703863023872:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857184.235992:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857184.235999:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 48 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236012:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 48 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236033:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828cd expref: 48 pid: 5838 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236050:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.236055:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236064:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236072:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.236098:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857184.236160:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:2353:x1874703863023872:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 184us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857184.236168:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00010000:00010000:3.0:1787857184.236172:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.236180:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857184.236223:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787857184.236332:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857184.236358:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.236394:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbec48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828d4 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.236408:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828d4 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.236416:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:3.0:1787857184.236419:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857184.236422:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85600, rc 0) 00000100:00100000:3.0:1787857184.236447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:10400:x1874703863023744:12345-192.168.204.29@tcp:101:bash.0 Request processed in 5236us (7422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857184.236454:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:3.0:1787857184.238937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.239028:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863024128 00000100:00100000:2.0:1787857184.239037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863024128 00000100:00100000:2.0:1787857184.239088:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1787857184.239099:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d464050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:10400:x1874703863024128:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:2.0:1787857184.239388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d464050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10400:x1874703863024128:12345-192.168.204.29@tcp:35:bash.0 Request processed in 291us (458us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787857184.239396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1787857184.297639:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.297754:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863024384 00000100:00100000:2.0:1787857184.297763:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863024384 00000100:00100000:2.0:1787857184.297861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1787857184.297872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10410:x1874703863024384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857184.297898:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.297918:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857184.298055:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787857184.298500:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828db expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.298515:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:2.0:1787857184.298518:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857184.298524:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbec56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828db expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.298550:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85200, rc 0) 00000100:00100000:2.0:1787857184.298713:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:10410:x1874703863024384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 842us (1082us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787857184.298737:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:3.0:1787857184.302879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.302975:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863024512 00000100:00100000:2.0:1787857184.302985:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863024512 00000100:00100000:2.0:1787857184.303079:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:2.0:1787857184.303091:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:10410:x1874703863024512:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1787857184.303475:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303495:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303507:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303523:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303541:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303548:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303646:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303655:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303749:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857184.303811:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303824:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303831:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303838:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303844:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.303848:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303856:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303880:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857184.303883:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857184.303888:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303895:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbec64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303908:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303914:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303932:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303937:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.303940:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303945:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303953:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362900) 00010000:00010000:2.0:1787857184.303955:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857184.303958:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303964:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbec6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303977:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303982:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303987:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.303992:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.303994:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.304009:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.304018:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.304020:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857184.304022:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.304026:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857184.304151:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:10410:x1874703863024512:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1061us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857184.304159:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1787857184.307482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.307577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863024768 00000100:00100000:1.0:1787857184.307586:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863024768 00000100:00100000:1.0:1787857184.307713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1787857184.307724:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:10410:x1874703863024768:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1787857184.307993:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10410:x1874703863024768:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 270us (522us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787857184.308001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857184.343786:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.344018:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025024 00000100:00100000:3.0:1787857184.344028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025024 00000100:00100000:3.0:1787857184.344178:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:3.0:1787857184.344189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10413:x1874703863025024:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857184.344213:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857184.344234:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbec79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344311:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344325:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344350:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344366:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344381:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344503:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbec8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344513:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbec8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344521:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbec8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857184.344542:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787857184.344630:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344637:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344645:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344651:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216cc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.344715:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344724:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344735:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857184.344738:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857184.344742:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344749:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbec80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344764:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344771:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344777:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344781:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.344784:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344791:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344798:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd946159300) 00010000:00010000:3.0:1787857184.344800:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857184.344808:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344815:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbec87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344855:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbec79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e2 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344870:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbec8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e2 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.344877:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:3.0:1787857184.344880:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857184.344882:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:3.0:1787857184.344940:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10413:x1874703863025024:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 753us (1166us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787857184.344948:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:3.0:1787857184.351097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.351144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.351615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025152 00000100:00100000:2.0:1787857184.351627:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025152 00000100:00100000:2.0:1787857184.351764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:2.0:1787857184.351775:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10413:x1874703863025152:12345-192.168.204.29@tcp:54:lfs.0 00000100:00100000:0.0:1787857184.351844:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025280 00000100:00100000:0.0:1787857184.351850:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025280 00000100:00100000:0.0:1787857184.351898:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1787857184.351907:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:2353:x1874703863025280:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857184.351919:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857184.351926:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.351955:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.351967:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.351993:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.352019:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.352022:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbec8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e2 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.352033:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.352042:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857184.352046:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.352048:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857184.352061:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857184.352062:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.352075:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.352078:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857184.352082:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.352094:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbec9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857184.352127:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:2353:x1874703863025280:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 221us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857184.352135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10413:x1874703863025152:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 361us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857184.352140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1787857184.352150:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:1.0:1787857184.354015:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.354069:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025536 00000100:00100000:2.0:1787857184.354077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025536 00000100:00100000:2.0:1787857184.354124:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1787857184.354134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+50:10413:x1874703863025536:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857184.354328:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10413:x1874703863025536:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 195us (319us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787857184.354342:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1787857184.536786:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.536919:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025792 00000100:00100000:2.0:1787857184.536934:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025792 00000100:00100000:2.0:1787857184.537006:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1787857184.537017:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10431:x1874703863025792:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1787857184.537048:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.537070:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbeca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828e9 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.537193:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbecaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.537211:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbecaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.537225:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbecaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857184.537235:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787857184.537364:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbeca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e9 expref: 54 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.537384:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbecaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e9 expref: 53 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.537393:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:2.0:1787857184.537396:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787857184.537400:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84000, rc 0) 00000100:00100000:2.0:1787857184.537486:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:10431:x1874703863025792:12345-192.168.204.29@tcp:101:cat.0 Request processed in 470us (712us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787857184.537495:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:3.0:1787857184.570608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857184.570941:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863025920 00000100:00100000:2.0:1787857184.570955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863025920 00000100:00100000:2.0:1787857184.571080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1787857184.571092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:10432:x1874703863025920:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857184.571115:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857184.571135:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbecb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571200:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571214:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571227:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857184.571289:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787857184.571293:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857184.571316:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571344:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbecb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f0 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571363:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f0 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857184.571393:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857184.571396:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857184.571399:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84600, rc 0) 00000100:00100000:2.0:1787857184.571489:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10432:x1874703863025920:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 399us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857184.571496:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:1.0:1787857184.576984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.577148:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026304 00000100:00100000:0.0:1787857184.577159:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026304 00000100:00100000:0.0:1787857184.577229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1787857184.577350:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10432:x1874703863026304:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857184.578383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10432:x1874703863026304:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 975us (1237us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787857184.578408:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:3.0:1787857184.583345:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.583440:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026432 00000100:00100000:1.0:1787857184.583451:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026432 00000100:00100000:1.0:1787857184.583540:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857184.583551:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10432:x1874703863026432:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:1.0:1787857184.583567:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857184.583595:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbec4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828d4 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.583628:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbecaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828e9 expref: 54 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.583652:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd953489400/0xf326646fe3bbeb5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882895 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.583712:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857184.583724:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857184.583780:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10432:x1874703863026432:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 230us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857184.583793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1787857184.589078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.589111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026560 00000100:00100000:3.0:1787857184.589123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026560 00000100:00100000:3.0:1787857184.589173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:3.0:1787857184.589183:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10432:x1874703863026560:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:3.0:1787857184.590034:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.590071:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.590084:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857184.592734:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787857184.593452:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787857184.593550:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787857184.593705:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10432:x1874703863026560:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 4517us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857184.593718:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:3.0:1787857184.614167:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.614251:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026688 00000100:00100000:0.0:1787857184.614261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026688 00000100:00100000:0.0:1787857184.614322:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:0.0:1787857184.614333:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10434:x1874703863026688:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857184.614356:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857184.614377:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbeccd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828f7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614445:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614471:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614485:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614491:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614498:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614825:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614857:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614866:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857184.614902:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787857184.614906:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857184.614923:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614935:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614943:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614949:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614956:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614962:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857184.614967:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614975:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.614986:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857184.614989:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857184.615000:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615007:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbecd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615021:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615028:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615034:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615039:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857184.615042:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615048:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615056:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd953423200) 00010000:00010000:0.0:1787857184.615059:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857184.615062:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615067:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbecdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615096:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbeccd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615120:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.615128:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:0.0:1787857184.615130:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857184.615133:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857184.615194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:10434:x1874703863026688:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 864us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857184.615202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000001:00080000:3.0:1787857184.643284:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:3.0:1787857184.643307:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd942fad180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787857184.643312:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd945c2b600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd942fad840 00000020:00080000:3.0:1787857184.643316:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd945c2b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97fdedc00 00000004:00080000:3.0:1787857184.643355:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787857184.643460:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787857184.643585:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787857184.643825:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885071232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857184.643914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857184.644220:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885071232 00000100:00100000:0.0:1787857184.644228:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885071232 00000100:00100000:0.0:1787857184.644287:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857184.644297:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874703885071232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787857184.644324:0:6679:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787857184.644356:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a90891d, atime: 0x6a90891e, ctime: 0x6a90891d, blocks: 0x1 00010000:00010000:0.0:1787857184.644365:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.644381:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1787857184.644386:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857184.644393:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.644408:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.644436:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.644443:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.644458:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787857184.644818:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857184.645219:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885071232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 922us (1303us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787857184.645228:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787857184.645305:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857184.645314:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.645323:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857184.645328:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.645337:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.645366:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.645375:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbece9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.645396:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857184.645398:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857184.645399:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857184.645466:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd96d8ac780/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787857184.645473:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885071232:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1787857184.903908:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857184.903917:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857184.903956:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787857184.903963:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857184.904087:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885071360:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857184.904187:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942fad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857184.907215:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885071360:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857184.920862:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.922052:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026816 00000100:00100000:0.0:1787857184.922061:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026816 00000100:00100000:0.0:1787857184.922113:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1787857184.922123:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863026816:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787857184.922198:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863026816:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 Request processed in 77us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857184.922206:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1787857184.926368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.927451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863026944 00000100:00100000:1.0:1787857184.927463:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863026944 00000100:00100000:1.0:1787857184.927556:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:1.0:1787857184.927568:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863026944:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857184.927606:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857184.927748:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863026944:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 183us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857184.927755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:3.0:1787857184.930188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.930217:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863027072 00000100:00100000:3.0:1787857184.930224:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863027072 00000100:00100000:3.0:1787857184.930916:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:3.0:1787857184.930928:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863027072:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857184.930995:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931012:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931025:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931073:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931082:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931101:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931126:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931134:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931157:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857184.931191:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787857184.931195:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857184.931207:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931218:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931225:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931232:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931238:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.931242:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931317:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931339:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:3.0:1787857184.931342:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857184.931347:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931353:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbecf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931367:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931373:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931380:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931384:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.931387:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931394:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931401:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fd946159a00) 00010000:00010000:3.0:1787857184.931403:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857184.931405:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931411:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbecf7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931448:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931454:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931460:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931466:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216cc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.931468:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931475:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931482:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:3.0:1787857184.931484:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857184.931487:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.931493:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbecfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857184.931825:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863027072:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 898us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857184.931833:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:3.0:1787857184.934848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.934893:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863027328 00000100:00100000:3.0:1787857184.934900:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863027328 00000100:00100000:3.0:1787857184.934956:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:3.0:1787857184.934966:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10445:x1874703863027328:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857184.934987:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857184.935006:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbed05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8828fe expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935102:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935117:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935128:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857184.935138:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787857184.935325:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935333:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935339:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935345:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.935349:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935356:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935379:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:3.0:1787857184.935382:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857184.935386:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935394:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbed0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935430:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbed05 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828fe expref: 13 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935440:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:3.0:1787857184.935443:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857184.935446:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbed05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828fe expref: 13 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.935456:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:3.0:1787857184.935510:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863027328:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 545us (670us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787857184.935529:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:3.0:1787857184.938112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.938149:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863027456 00000100:00100000:3.0:1787857184.938156:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863027456 00000100:00100000:3.0:1787857184.938202:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:3.0:1787857184.938210:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863027456:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857184.938241:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857184.938344:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863027456:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 133us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857184.938369:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:3.0:1787857184.940968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.941305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863027712 00000100:00100000:0.0:1787857184.941315:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863027712 00000100:00100000:0.0:1787857184.941366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:0.0:1787857184.941375:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863027712:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857184.941394:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857184.941396:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787857184.941422:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbecbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f0 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.941441:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857184.941447:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857184.941459:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbed1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882905 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857184.942117:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787857184.942325:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbed21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.942338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbed21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.942348:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbed21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.942396:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbed1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882905 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.942410:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbed21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882905 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.942429:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423600) 00010000:00010000:0.0:1787857184.942432:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857184.942434:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560000, rc 0) 00000100:00100000:0.0:1787857184.942486:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863027712:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1112us (1527us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787857184.942493:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:3.0:1787857184.945805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.946890:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863027968 00000100:00100000:1.0:1787857184.946902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863027968 00000100:00100000:1.0:1787857184.946959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:1.0:1787857184.946970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863027968:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857184.947106:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857184.947319:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbed21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882905 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947339:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423600) 00010000:00010000:1.0:1787857184.947352:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857184.947377:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947391:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947402:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947463:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947480:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947487:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947815:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947823:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947829:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947836:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857184.947840:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947848:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947858:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857184.947861:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857184.947870:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947876:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbed2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947885:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947898:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947904:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947909:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857184.947912:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947919:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947928:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x452e798f (ffff9fd963a5fa00) 00010000:00010000:1.0:1787857184.947931:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857184.947934:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.947940:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x452e798f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857184.948415:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863027968:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1444us (2618us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787857184.948425:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:2.0:1787857184.955548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857184.955727:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028096 00000100:00100000:0.0:1787857184.955737:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028096 00000100:00100000:0.0:1787857184.955789:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:0.0:1787857184.955798:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863028096:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857184.955819:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857184.955850:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbed3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88290c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.955894:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.955907:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.955919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.956013:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbed3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.956028:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857184.956043:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857184.956046:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857184.956050:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561e00, rc 0) 00000100:00100000:0.0:1787857184.956104:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863028096:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 308us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857184.956111:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:2.0:1787857184.959224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.959296:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028352 00000100:00100000:1.0:1787857184.959306:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028352 00000100:00100000:1.0:1787857184.959369:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:1.0:1787857184.959378:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863028352:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857184.959450:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.959479:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.959490:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857184.959831:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787857184.959840:0:8856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339288179753ns, next at 340288177304ns, rc = 0 00000004:00010000:1.0:1787857184.960117:0:8856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe61e4d6 reply state 00000000c0a278a2 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857184.960128:0:8856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857184.960221:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10445:x1874703863028352:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 842us (1006us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787857184.960229:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00010000:00010000:3.0:1787857184.961401:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961414:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961421:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961428:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857184.961434:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961442:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961459:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:3.0:1787857184.961462:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857184.961467:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857184.961473:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbed4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857184.967653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857184.967803:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028480 00000100:00100000:1.0:1787857184.967812:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028480 00000100:00100000:1.0:1787857184.967871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:1.0:1787857184.967881:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10445:x1874703863028480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857184.967914:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857184.967933:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882913 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.967992:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.968006:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857184.968038:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:1.0:1787857184.968041:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857184.968056:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978400, rc 0) 00000100:00100000:1.0:1787857184.968112:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10445:x1874703863028480:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 233us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857184.968120:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1787857184.977729:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.982231:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028608 00000100:00100000:3.0:1787857184.982247:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028608 00000100:00100000:3.0:1787857184.982290:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1787857184.982306:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863028608:12345-192.168.204.29@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787857184.982344:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787857184.982397:0:6678:0:(genops.c:1385:class_connect()) connect: client 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1, cookie 0xf326646fe3bbed59 00002000:00100000:3.0:1787857184.982410:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1/ffff9fd96dd90800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857184.982432:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857184.982699:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787857184.982733:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd96dd94000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857184.982813:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2351:x1874703863028608:12345-192.168.204.29@tcp:8:lhsmtool_posix.0 Request processed in 507us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857184.985100:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:1.0:1787857184.986809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857184.986974:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028736 00000100:00100000:3.0:1787857184.986984:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028736 00000100:00100000:3.0:1787857184.987041:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1787857184.987050:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:0:x1874703863028736:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787857184.988479:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787857185.037242:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787857185.037259:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000100:00100000:2.0:1787857185.037321:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:0:x1874703863028736:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 50265us (50508us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787857185.037334:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:3.0:1787857185.040016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.042174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863028992 00000100:00100000:2.0:1787857185.042195:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863028992 00000100:00080000:3.0:1787857185.042281:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857185.042327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1787857185.042345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10445:x1874703863028992:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857185.044491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10445:x1874703863028992:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 2139us (4470us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787857185.044507:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1787857185.047414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.047484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863029248 00000100:00100000:0.0:1787857185.047495:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863029248 00000100:00100000:0.0:1787857185.048027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1787857185.048038:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a639680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10445:x1874703863029248:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857185.048137:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a639680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10445:x1874703863029248:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 101us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.048144:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:3.0:1787857185.050641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.050748:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863029376 00000100:00100000:2.0:1787857185.050758:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863029376 00000100:00100000:0.0:1787857185.050978:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:0.0:1787857185.050988:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10445:x1874703863029376:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857185.051005:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857185.051023:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbed60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88291a expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051086:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051099:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051110:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857185.051158:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857185.051178:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051202:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbed60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88291a expref: 18 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051218:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88291a expref: 17 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.051228:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857185.051230:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857185.051234:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857185.051290:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10445:x1874703863029376:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 305us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.051297:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1787857185.054945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.055023:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863029504 00000100:00100000:1.0:1787857185.055034:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863029504 00000100:00100000:1.0:1787857185.055104:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1787857185.055115:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863029504:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857185.055133:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857185.055154:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882921 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857185.055182:0:8078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908920, blocks: 0x1 00010000:00010000:1.0:1787857185.055203:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787857185.055207:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857185.055217:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 6 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.055270:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 6 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.055283:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978a00, rc 0) 00000100:00100000:1.0:1787857185.055348:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863029504:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 235us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.055357:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:1.0:1787857185.058118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.058176:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863029760 00000100:00100000:3.0:1787857185.058187:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863029760 00000100:00100000:3.0:1787857185.058243:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1787857185.058252:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10445:x1874703863029760:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857185.058407:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10445:x1874703863029760:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 155us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857185.058415:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:3.0:1787857185.060434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.061241:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863029888 00000100:00100000:1.0:1787857185.061262:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863029888 00000100:00100000:1.0:1787857185.061323:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:1.0:1787857185.061333:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:10445:x1874703863029888:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857185.061349:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857185.061366:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882928 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.061399:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.061408:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857185.061412:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857185.061418:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.061451:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.061479:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.061494:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885071488:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857185.061601:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948be0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.068395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.069084:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885071488:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857185.069125:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.069149:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979800, rc 0) 00000100:00100000:1.0:1787857185.069218:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:10445:x1874703863029888:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 7887us (8790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.069228:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:3.0:1787857185.069359:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030016 00000100:00100000:3.0:1787857185.069366:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030016 00010000:00010000:3.0:1787857185.069398:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857185.069423:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1787857185.069431:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863030016:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857185.069446:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857185.070519:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.070545:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.070575:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d14ac45/0xf326646fe3bbed6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882921 expref: 7 pid: 8078 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.070590:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857185.070594:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857185.070602:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.070613:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.070693:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857185.070709:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fde7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885071616:192.168.204.29@tcp:105: 00000100:00100000:3.0:1787857185.070780:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97fa51540 going to sleep for 11 seconds 00000100:00100000:0.0:1787857185.073938:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fde7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885071616:192.168.204.29@tcp:105: 00010000:00010000:0.0:1787857185.073963:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857185.074016:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863030016:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4584us (5630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.074027:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:2.0:1787857185.080224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.080299:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030144 00000100:00100000:0.0:1787857185.080309:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030144 00002000:00100000:0.0:1787857185.080358:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fd981f74f00 x1874703863030144/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:586/0 lens 504/0 e 0 to 0 dl 1787857196 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857185.080370:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f74f00 with x1874703863030144 ext(0->8) 00002000:00010000:0.0:1787857185.080389:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd981f74f00 00000100:00100000:0.0:1787857185.080420:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1787857185.080429:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863030144:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857185.081239:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f74f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863030144:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 808us (1021us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787857185.081247:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00002000:00100000:0.0:1787857185.081255:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fd981f74f00 x1874703863030144/t4294967302(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:586/0 lens 504/448 e 0 to 0 dl 1787857196 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857185.081264:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f74f00 with x1874703863030144 ext(0->8) 00002000:00010000:0.0:1787857185.081268:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd981f74f00 00000100:00100000:2.0:1787857185.091180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.091320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030272 00000100:00100000:3.0:1787857185.091329:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030272 00000100:00100000:3.0:1787857185.091389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1787857185.091399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10445:x1874703863030272:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787857185.142563:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1787857185.142684:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787857185.142689:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787857185.142703:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787857185.142715:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1787857185.142771:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787857185.142781:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787857185.143072:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885071744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787857185.143139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857185.143259:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885071744 00000100:00100000:2.0:1787857185.143265:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885071744 00000100:00100000:2.0:1787857185.143321:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787857185.143330:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885071744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857185.143471:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787857185.143475:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787857184 00002000:00010000:2.0:1787857185.143477:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857185.143480:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787857184 -> 1787857184 00002000:00010000:2.0:1787857185.143482:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857185.143532:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885071744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (393us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787857185.143540:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787857185.143620:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787857185.143653:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd981ee0000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787857185.143682:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885071744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787857185.143684:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863030272:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 52282us (52509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.143695:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1787857185.145938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.146064:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030400 00000100:00100000:3.0:1787857185.146072:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030400 00000100:00100000:3.0:1787857185.146157:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:3.0:1787857185.146167:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2355:x1874703863030400:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787857185.165739:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787857185.165759:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787857185.165942:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703863030400:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 19771us (20005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.165954:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:2.0:1787857185.168291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.168376:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030656 00000100:00100000:0.0:1787857185.168386:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030656 00000100:00100000:0.0:1787857185.168441:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:0.0:1787857185.168450:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863030656:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857185.168501:0:8856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857185.168581:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88291a expref: 13 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.168600:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857185.168605:0:8856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857185.168633:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.168705:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.168716:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857185.169102:0:8856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002861375 reply state 000000009640030c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.169112:0:8856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857185.169200:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10445:x1874703863030656:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 751us (914us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787857185.169208:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00010000:00010000:1.0:1787857185.171489:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171505:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171522:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171540:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.171545:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171553:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171568:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:1.0:1787857185.171571:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.171576:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.171583:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.171731:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.172093:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863030784 00000100:00100000:3.0:1787857185.172102:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863030784 00000100:00100000:3.0:1787857185.172151:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1787857185.172160:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863030784:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857185.172377:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787857185.172380:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787857184 -> 1787857183 00002000:00010000:3.0:1787857185.172383:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787857182 00002000:00010000:3.0:1787857185.172385:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787857184 -> 1787857183 00002000:00010000:3.0:1787857185.172387:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787857185.172485:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863030784:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 324us (755us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787857185.172492:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1787857185.173959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.174046:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031040 00000100:00100000:1.0:1787857185.174053:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031040 00000100:00100000:1.0:1787857185.174127:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:1.0:1787857185.174135:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:10445:x1874703863031040:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787857185.174187:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.174201:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.174209:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.174238:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.174261:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 13 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.174275:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885071872:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857185.174395:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.176470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.176523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031168 00000100:00100000:0.0:1787857185.176531:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031168 00010000:00010000:0.0:1787857185.176568:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 14 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.176571:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885071872:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857185.176599:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.176619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1787857185.176629:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2353:x1874703863031168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857185.176644:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857185.176651:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 14 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176687:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 14 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176710:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88290c expref: 14 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176738:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857185.176743:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176752:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176760:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.176785:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857185.176829:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:2353:x1874703863031168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 201us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.176836:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00010000:00010000:1.0:1787857185.176951:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.176959:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.176986:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.176992:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.177000:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.177005:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.177009:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.177016:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.177032:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:1.0:1787857185.177035:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787857185.177039:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.177045:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbed83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.177090:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863031040:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 2955us (3138us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787857185.177098:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1787857185.179831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.179949:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031296 00000100:00100000:1.0:1787857185.179958:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031296 00000100:00100000:1.0:1787857185.180040:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:1.0:1787857185.180048:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863031296:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857185.180084:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.180102:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.180112:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857185.180116:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857185.180121:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.180152:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.180178:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.180193:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885072000:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857185.180280:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.184657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.184719:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031424 00000100:00100000:2.0:1787857185.184727:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031424 00010000:00010000:2.0:1787857185.184763:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 8 pid: 6676 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.184810:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:2.0:1787857185.184828:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863031424:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857185.184852:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857185.184874:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 8 pid: 6676 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.184899:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 8 pid: 6676 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.184925:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857185.184930:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857185.184938:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.184949:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.184969:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857185.185018:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863031424:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 199us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.185026:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00010000:00010000:1.0:1787857185.186957:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbed75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882928 expref: 7 pid: 6676 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.186977:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96de9ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885072000:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857185.187000:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187052:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187064:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187098:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187107:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187115:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187130:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857185.187135:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187146:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187164:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.187172:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cda30a0/0xf326646fe3bbed8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.187311:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863031296:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 7262us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.187321:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:3.0:1787857185.188466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.188557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031680 00000100:00100000:0.0:1787857185.188565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031680 00000100:00100000:0.0:1787857185.188651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:0.0:1787857185.188681:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:10445:x1874703863031680:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857185.188757:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.188772:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.188792:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.188984:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.188995:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.189005:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.189034:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.189048:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 13 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.189061:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885072128:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857185.189130:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.193881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.193973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031808 00000100:00100000:1.0:1787857185.193982:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031808 00000100:00100000:0.0:1787857185.194009:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885072128:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857185.194022:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 14 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.194035:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.194065:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1787857185.194073:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2353:x1874703863031808:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857185.194087:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857185.194094:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 14 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194107:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 14 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194135:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbed52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882913 expref: 14 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194148:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:1.0:1787857185.194153:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194162:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194170:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.194196:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857185.194218:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.194227:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.194248:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:2353:x1874703863031808:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 175us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.194257:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000001:00080000:0.0:1787857185.194487:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787857185.194735:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787857185.194784:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787857185.194859:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874703885072256:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787857185.194908:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857185.195134:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.195615:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885072256 00000100:00100000:2.0:1787857185.195622:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885072256 00000100:00100000:2.0:1787857185.195699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787857185.195709:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874703885072256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857185.195788:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874703885072256:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.195796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857185.195895:0:5838:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787857185.195901:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd981ee0000, transno 4294967303 00000100:00100000:0.0:1787857185.195919:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874703885072256:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787857185.196881:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787857185.196944:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874703885072384:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787857185.196989:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857185.197011:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.197203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885072384 00000100:00100000:2.0:1787857185.197209:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885072384 00000100:00100000:2.0:1787857185.197254:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857185.197265:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1874703885072384:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787857185.197433:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1874703885072384:12345-0@lo:1000:mdt00_002.0 Request processed in 171us (444us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787857185.197442:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857185.197501:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5838:1874703885072384:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787857185.197543:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197552:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197560:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197566:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857185.197571:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197580:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197601:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857185.197604:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857185.197610:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197617:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbed98 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197652:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197733:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197740:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197745:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857185.197748:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197754:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197763:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:0.0:1787857185.197766:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857185.197769:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197775:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbecc6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197811:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197827:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197836:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197862:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.197876:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 16 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.197886:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885072512:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857185.197997:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.200836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.200867:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863031936 00000100:00100000:2.0:1787857185.200876:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863031936 00010000:00010000:2.0:1787857185.200917:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 17 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.200953:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:2.0:1787857185.200963:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:2352:x1874703863031936:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857185.200979:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857185.200986:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 17 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201001:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 17 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201022:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:2.0:1787857185.201028:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201038:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201060:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201080:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857185.201130:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:2352:x1874703863031936:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 167us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.201137:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00010000:00010000:2.0:1787857185.201272:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbece2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8828f7 expref: 16 pid: 5836 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.201289:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885072512:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857185.201310:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201319:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201326:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201338:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201344:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201351:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201357:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.201368:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201377:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201387:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:2.0:1787857185.201391:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.201394:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201401:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbed9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201413:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201419:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201425:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201431:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.201434:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201440:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201448:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd946159300) 00010000:00010000:2.0:1787857185.201450:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857185.201459:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.201464:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbed91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857185.202377:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857185.202383:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857185.202411:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787857185.202418:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857185.202505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10445:x1874703863031680:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 13843us (14039us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787857185.202527:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000020:00080000:2.0:1787857185.202532:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:3.0:1787857185.225154:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857185.226936:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.227024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863032192 00000100:00100000:3.0:1787857185.227038:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863032192 00000100:00100000:3.0:1787857185.227117:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1787857185.227132:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10445:x1874703863032192:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787857185.231627:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787857185.232188:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787857185.232296:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232324:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232340:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232351:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232358:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232380:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.232419:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857185.233328:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857185.233341:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.233351:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857185.233355:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.233364:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.233383:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fd949362700) 00010000:00010000:1.0:1787857185.233397:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857185.233403:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.233411:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbeda6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.233434:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857185.233436:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857185.235284:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857185.236980:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10445:x1874703863032192:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 9837us (10044us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787857185.236999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000020:00080000:2.0:1787857185.237009:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1787857185.302068:0:11992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857185.302077:0:11992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857185.302130:0:11992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787857185.302138:0:11992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857185.426754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.426906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863032448 00000100:00100000:0.0:1787857185.426916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863032448 00000100:00100000:0.0:1787857185.426963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1787857185.426972:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:10455:x1874703863032448:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857185.426993:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857185.427012:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbedad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88292f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.427250:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbedb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.427273:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbedb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.427284:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbedb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857185.427297:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787857185.427517:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbedad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88292f expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.427534:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbedb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88292f expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.427543:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857185.427546:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857185.427550:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561000, rc 0) 00000100:00100000:0.0:1787857185.427722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10455:x1874703863032448:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 750us (974us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787857185.427730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:3.0:1787857185.433644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.440983:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863032576 00000100:00100000:1.0:1787857185.440998:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863032576 00000100:00100000:1.0:1787857185.441076:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:1.0:1787857185.441086:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10455:x1874703863032576:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1787857185.441172:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441190:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441201:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441215:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441221:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441227:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441529:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441536:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441542:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857185.441577:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441587:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441593:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441599:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441604:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.441608:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441615:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441626:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857185.441629:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.441633:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441644:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbedc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441654:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441682:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441687:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441691:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.441694:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441699:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441706:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd963a5f800) 00010000:00010000:1.0:1787857185.441708:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.441711:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441716:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbedc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441729:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441735:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441745:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441751:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.441753:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441759:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441767:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857185.441769:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.441771:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.441777:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbedd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.441867:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10455:x1874703863032576:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 782us (8233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.441881:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:1.0:1787857185.496713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.496945:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863032832 00000100:00100000:2.0:1787857185.496956:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863032832 00000100:00100000:2.0:1787857185.497016:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:2.0:1787857185.497026:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10458:x1874703863032832:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857185.497046:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857185.497065:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbedd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882936 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497136:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497150:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497161:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497176:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497192:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497216:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497968:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497981:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.497991:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857185.498002:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787857185.498099:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498107:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498114:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498121:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.498125:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498133:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498215:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857185.498219:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.498232:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbedde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498252:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498259:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498265:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498271:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.498274:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498280:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498289:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362900) 00010000:00010000:2.0:1787857185.498291:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.498294:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498301:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbede5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498344:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbedd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498371:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.498379:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857185.498382:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857185.498455:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857185.498534:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10458:x1874703863032832:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1508us (1831us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787857185.498543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:3.0:1787857185.507753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.508110:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863032960 00000100:00100000:0.0:1787857185.508119:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863032960 00000100:00100000:0.0:1787857185.508218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:0.0:1787857185.508229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10458:x1874703863032960:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857185.508296:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508314:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508345:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508371:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508378:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508385:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508391:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857185.508396:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508403:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508416:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857185.508420:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857185.508425:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.508432:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbedfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.508553:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10458:x1874703863032960:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 326us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.508562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:3.0:1787857185.511125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.511219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863033216 00000100:00100000:2.0:1787857185.511231:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863033216 00000100:00100000:2.0:1787857185.511298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857185.511309:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d465450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10458:x1874703863033216:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857185.511540:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d465450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:10458:x1874703863033216:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 232us (422us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787857185.511548:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857185.553061:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.553183:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863033472 00000100:00100000:1.0:1787857185.553195:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863033472 00000100:00100000:1.0:1787857185.553428:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1787857185.553442:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:9986:x1874703863033472:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857185.553478:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857185.553522:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbee01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88293d expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.553730:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.553748:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.553758:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.553858:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.553873:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 23 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.553887:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b767840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885072640:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857185.554013:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.563579:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b767840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885072640:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857185.563615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:2.0:1787857185.563619:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.563685:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863033600 00000100:00100000:0.0:1787857185.563704:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863033600 00010000:00010000:0.0:1787857185.563743:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 24 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.563795:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1787857185.563806:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:2353:x1874703863033600:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857185.563820:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857185.563828:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 24 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563851:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 24 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563877:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbedec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882936 expref: 24 pid: 5838 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563895:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857185.563900:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563910:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563917:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.563952:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857185.564012:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:2353:x1874703863033600:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 207us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.564030:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00010000:00010000:1.0:1787857185.565930:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.565957:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857185.565983:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787857185.566168:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbee01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 24 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.566188:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 23 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.566197:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:1.0:1787857185.566200:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787857185.566203:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979800, rc 0) 00000100:00100000:1.0:1787857185.566284:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:9986:x1874703863033472:12345-192.168.204.29@tcp:101:bash.0 Request processed in 12837us (13222us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787857185.566311:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1787857185.570464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.571027:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863033856 00000100:00100000:2.0:1787857185.571037:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863033856 00000100:00100000:2.0:1787857185.571153:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:2.0:1787857185.571165:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:9986:x1874703863033856:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:2.0:1787857185.571456:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.571478:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.571491:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857185.571557:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787857185.571581:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006266d2c reply state 000000001b651723 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.571590:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787857185.571633:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787857185.571786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:9986:x1874703863033856:12345-192.168.204.29@tcp:36:bash.0 Request processed in 622us (1334us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787857185.571795:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000020:00080000:2.0:1787857185.571801:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787857185.575865:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575899:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575906:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575912:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857185.575917:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575924:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575945:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:3.0:1787857185.575948:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857185.575953:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.575960:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbee16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.578972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.579079:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863033984 00000100:00100000:0.0:1787857185.579088:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863033984 00000100:00100000:0.0:1787857185.579146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:0.0:1787857185.579156:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:9986:x1874703863033984:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857185.579180:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857185.579202:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbee1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882944 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.579276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbee1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882944 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.579292:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbee1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882944 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.579312:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857185.579315:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857185.579320:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560000, rc 0) 00000100:00100000:0.0:1787857185.579389:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:9986:x1874703863033984:12345-192.168.204.29@tcp:101:bash.0 Request processed in 234us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.579396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 90 00000100:00100000:0.0:1787857185.591444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.591804:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863034112 00000100:00100000:1.0:1787857185.591825:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863034112 00000100:00100000:1.0:1787857185.591893:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857185.591904:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:9986:x1874703863034112:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857185.591923:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857185.591949:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88294b expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857185.591975:0:8078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90891f, atime: 0x6a90891e, ctime: 0x6a90891f, blocks: 0xb 00010000:00010000:1.0:1787857185.591998:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787857185.592003:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857185.592012:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 7 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.592029:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 7 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.592042:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978400, rc 0) 00000100:00100000:1.0:1787857185.592112:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:9986:x1874703863034112:12345-192.168.204.29@tcp:101:bash.0 Request processed in 210us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.592119:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857185.595235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.595623:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863034240 00000100:00100000:3.0:1787857185.595634:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863034240 00002000:00010000:3.0:1787857185.595877:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787857185.595883:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd96de9cf00 with x1874703863034240 ext(0->18446744073709551615) 00002000:00010000:3.0:1787857185.595896:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd96de9cf00. 00000100:00100000:3.0:1787857185.595929:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1787857185.595939:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863034240:12345-192.168.204.29@tcp:10:bash.0 00002000:00010000:3.0:1787857185.599899:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787857185.599922:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787857183 -> 1787857185 00002000:00010000:3.0:1787857185.599925:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787857182 -> 1787857182 00002000:00010000:3.0:1787857185.599927:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787857183 -> 1787857185 00002000:00010000:3.0:1787857185.599929:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787857185.600061:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863034240:12345-192.168.204.29@tcp:10:bash.0 Request processed in 4117us (4833us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787857185.600073:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00002000:00010000:3.0:1787857185.600080:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787857185.600083:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd96de9cf00 with x1874703863034240 ext(0->18446744073709551615) 00002000:00010000:3.0:1787857185.600090:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd96de9cf00. 00000100:00100000:2.0:1787857185.698724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.698794:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863034368 00000100:00100000:1.0:1787857185.698804:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863034368 00000100:00100000:1.0:1787857185.698866:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:1.0:1787857185.698876:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10472:x1874703863034368:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:1.0:1787857185.698945:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.698963:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.698977:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.698992:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.698999:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699005:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699236:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699244:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699252:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857185.699290:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699309:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699315:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699321:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699328:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.699332:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699339:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699351:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857185.699354:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.699358:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699363:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbee2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699387:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699393:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699398:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699409:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.699411:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699416:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699423:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd963a5ff00) 00010000:00010000:1.0:1787857185.699426:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.699428:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699434:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbee32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699446:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699462:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699468:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699472:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.699475:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699480:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699496:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:1.0:1787857185.699498:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.699525:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.699531:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbee39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.699606:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10472:x1874703863034368:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 731us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.699617:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:0.0:1787857185.726264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.726691:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863034624 00000100:00100000:2.0:1787857185.726703:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863034624 00000100:00100000:2.0:1787857185.726781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:2.0:1787857185.726791:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10475:x1874703863034624:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857185.726815:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857185.726842:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbee40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882952 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.726920:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.726935:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.726947:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.726960:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.727307:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.727316:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728547:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbee55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728562:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbee55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728572:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbee55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857185.728602:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787857185.728735:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728743:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728750:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728757:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.728762:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728771:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728796:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857185.728800:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.728805:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728811:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728825:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728832:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728848:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728853:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.728856:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728863:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728871:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362900) 00010000:00010000:2.0:1787857185.728874:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.728877:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728882:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728928:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbee40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882952 expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728944:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbee55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882952 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.728952:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857185.728954:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857185.728957:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84e00, rc 0) 00000100:00100000:2.0:1787857185.729048:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9754852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10475:x1874703863034624:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2257us (2792us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787857185.729066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:2.0:1787857185.734587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.734817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863034752 00000100:00100000:3.0:1787857185.734826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863034752 00000100:00100000:3.0:1787857185.734901:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:3.0:1787857185.734909:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10475:x1874703863034752:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1787857185.734966:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.734980:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.734987:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.735019:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.735033:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 29 pid: 8856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857185.735080:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f4ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885072768:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857185.735169:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945798300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857185.738002:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f4ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885072768:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857185.738039:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.738448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.738517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863035008 00000100:00100000:0.0:1787857185.738524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863035008 00000100:00100000:0.0:1787857185.738586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:0.0:1787857185.738597:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:5591:x1874703863035008:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787857185.739387:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:5591:x1874703863035008:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 789us (937us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787857185.739396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:3.0:1787857185.740825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.741516:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863035136 00000100:00100000:2.0:1787857185.741526:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863035136 00010000:00010000:2.0:1787857185.741565:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 31 pid: 8856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.741619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:2.0:1787857185.741769:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:2353:x1874703863035136:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857185.741826:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857185.741835:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 31 pid: 8856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.741851:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 31 pid: 8856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.741875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbee08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88293d expref: 31 pid: 8856 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.741891:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857185.741896:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.741905:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.741913:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.742012:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857185.742122:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:2353:x1874703863035136:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 495us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.742131:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00010000:00010000:1.0:1787857185.742201:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742210:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742306:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742314:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742321:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742337:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.742341:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742349:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742360:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:1.0:1787857185.742364:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857185.742369:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.742375:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbee63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.742472:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10475:x1874703863034752:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 7562us (7937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857185.742480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:3.0:1787857185.745124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.745244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863035392 00000100:00100000:2.0:1787857185.745254:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863035392 00000100:00100000:2.0:1787857185.745311:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:2.0:1787857185.745322:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:10475:x1874703863035392:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857185.745567:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10475:x1874703863035392:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 246us (450us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787857185.745576:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1787857185.813858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.814070:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863035648 00000100:00100000:2.0:1787857185.814079:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863035648 00000100:00100000:2.0:1787857185.814144:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:2.0:1787857185.814155:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:10486:x1874703863035648:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1787857185.814178:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857185.814200:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbee6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882959 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814286:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814301:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814313:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814347:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814355:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.814362:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815265:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbee7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815294:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbee7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815303:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbee7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857185.815315:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787857185.815436:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815443:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815461:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815468:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.815472:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815490:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815512:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857185.815516:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.815520:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815526:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbee71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815539:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815545:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815550:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815555:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857185.815558:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815564:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815572:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362900) 00010000:00010000:2.0:1787857185.815574:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857185.815577:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815592:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbee78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815639:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbee6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882959 expref: 33 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815654:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbee7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882959 expref: 32 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.815725:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:2.0:1787857185.815727:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857185.815730:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85200, rc 0) 00000100:00100000:2.0:1787857185.815801:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975486d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:10486:x1874703863035648:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1648us (1952us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787857185.815819:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:3.0:1787857185.820326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.820467:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863035904 00000100:00100000:0.0:1787857185.820477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863035904 00000100:00100000:0.0:1787857185.820550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:0.0:1787857185.820560:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:10486:x1874703863035904:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1787857185.820839:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10486:x1874703863035904:12345-192.168.204.29@tcp:35:cat.0 Request processed in 280us (522us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787857185.820848:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:2.0:1787857185.834950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.835096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863036160 00000100:00100000:0.0:1787857185.835107:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863036160 00000100:00100000:0.0:1787857185.835167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:0.0:1787857185.835178:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10487:x1874703863036160:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:0.0:1787857185.835234:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787857185.835261:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbee7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882959 expref: 33 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835291:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbee55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882952 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835305:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbee1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882944 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835314:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd949362100) 00010000:00010000:0.0:1787857185.835339:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857185.835360:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835372:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835382:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835396:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835403:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.835410:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.836012:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.836023:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.836030:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857185.836930:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:0.0:1787857185.837004:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837017:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837033:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837041:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837048:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837053:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837084:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857185.837105:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837111:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837118:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837124:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857185.837128:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837136:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837147:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:0.0:1787857185.837151:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857185.837162:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837168:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbee9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837186:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837193:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837199:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837204:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857185.837206:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837213:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837221:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857185.837223:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857185.837226:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.837233:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbee8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857185.837242:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff4dfeb1 reply state 00000000eb7f49e0 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.837261:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857185.837357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:10487:x1874703863036160:12345-192.168.204.29@tcp:36:rm.0 Request processed in 2178us (2415us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787857185.837365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00010000:00010000:1.0:1787857185.837844:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857185.837852:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.837859:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857185.837863:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.837870:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.837879:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fd953423f00) 00010000:00010000:1.0:1787857185.837889:0:8436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857185.837893:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.837898:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbeea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.837916:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857185.837918:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857185.837920:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857185.842467:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842485:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842492:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842506:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857185.842511:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842518:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842535:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd9429cab00) 00010000:00010000:3.0:1787857185.842537:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857185.842542:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.842548:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbee94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.878832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857185.878945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863036416 00000100:00100000:1.0:1787857185.878955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863036416 00000100:00100000:1.0:1787857185.879031:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:1.0:1787857185.879041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:10493:x1874703863036416:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857185.879066:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857185.879098:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbeea9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882960 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879264:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879281:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879293:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879307:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879315:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.879337:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857185.880016:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787857185.880193:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880205:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880213:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880247:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880253:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880259:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880264:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857185.880268:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880275:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880287:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857185.880290:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857185.880302:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880308:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbeeb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857185.880322:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f79de3f reply state 00000000b7fc14de transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857185.880330:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857185.880360:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbeea9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880376:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857185.880384:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857185.880386:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857185.880389:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978e00, rc 0) 00000100:00100000:1.0:1787857185.880479:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:10493:x1874703863036416:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1438us (1657us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787857185.880488:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00010000:00010000:3.0:1787857185.884243:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884272:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884280:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884287:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857185.884291:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884299:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884317:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd963a5ff00) 00010000:00010000:3.0:1787857185.884320:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857185.884325:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.884332:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbeeb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.885468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857185.885727:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863036544 00000100:00100000:3.0:1787857185.885736:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863036544 00000100:00100000:3.0:1787857185.885802:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:3.0:1787857185.885812:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863036544:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1787857185.885830:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857185.885860:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882967 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857185.885890:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857185.885907:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1787857185.885912:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857185.885922:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.885941:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857185.885954:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045200, rc 0) 00000100:00100000:3.0:1787857185.886035:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863036544:12345-192.168.204.29@tcp:101:bash.0 Request processed in 225us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857185.886043:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00080000:1.0:1787857185.886468:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857185.889747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.889834:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863036672 00000100:00100000:0.0:1787857185.889844:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863036672 00000100:00100000:0.0:1787857185.889902:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1787857185.889913:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:10493:x1874703863036672:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857185.889930:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857185.889952:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88296e expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.890001:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.890011:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857185.890016:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857185.890022:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 9 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.890055:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.890069:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857185.890100:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975485680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885072896:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857185.890205:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857185.893479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857185.893740:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975485680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885072896:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857185.893773:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 9 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857185.893792:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561e00, rc 0) 00000100:00100000:0.0:1787857185.893842:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:10493:x1874703863036672:12345-192.168.204.29@tcp:101:bash.0 Request processed in 3931us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857185.893850:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1787857185.895545:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863036800 00000100:00100000:2.0:1787857185.895556:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863036800 00010000:00010000:2.0:1787857185.895593:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.895629:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:2.0:1787857185.895638:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863036800:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857185.895651:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857185.895688:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.895715:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.895738:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965ea854/0xf326646fe3bbeecc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882967 expref: 9 pid: 6679 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.895753:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857185.895757:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857185.895764:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.895774:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857185.895807:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857185.895820:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b765a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885073024:192.168.204.29@tcp:105: 00000100:00100000:2.0:1787857185.895896:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857185.898507:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b765a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885073024:192.168.204.29@tcp:105: 00010000:00010000:2.0:1787857185.898534:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857185.898590:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863036800:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2952us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857185.898602:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857185.900061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857185.900209:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037056 00000100:00100000:2.0:1787857185.900217:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037056 00000100:00100000:2.0:1787857185.900347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:2.0:1787857185.900544:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:10493:x1874703863037056:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:2.0:1787857185.901013:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:10493:x1874703863037056:12345-192.168.204.29@tcp:35:bash.0 Request processed in 655us (958us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787857185.901021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:0.0:1787857186.022940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.023099:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037184 00000100:00100000:2.0:1787857186.023113:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037184 00000100:00100000:2.0:1787857186.023183:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:2.0:1787857186.023194:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:10509:x1874703863037184:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857186.023231:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857186.023253:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbeeda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882975 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023329:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023345:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023357:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857186.023418:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787857186.023422:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857186.023444:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023469:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbeeda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882975 expref: 36 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023516:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882975 expref: 35 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.023525:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:2.0:1787857186.023528:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857186.023531:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84000, rc 0) 00000100:00100000:2.0:1787857186.023595:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:10509:x1874703863037184:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 404us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.023602:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:0.0:1787857186.027577:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.030361:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037440 00000100:00100000:2.0:1787857186.030375:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037440 00000100:00100000:2.0:1787857186.030872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:2.0:1787857186.030885:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:10509:x1874703863037440:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857186.031066:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857186.031089:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbeee8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88297c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.031264:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbeeef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.031333:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbeeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.031348:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbeeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857186.031362:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787857186.031958:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbeee8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88297c expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.031977:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbeeef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88297c expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.031986:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:2.0:1787857186.031989:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857186.031992:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84600, rc 0) 00000100:00100000:2.0:1787857186.032139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:10509:x1874703863037440:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1256us (4571us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787857186.032147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:0.0:1787857186.039996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.040047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.040281:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037568 00000100:00100000:2.0:1787857186.040292:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037568 00000100:00100000:3.0:1787857186.040304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037824 00000100:00100000:3.0:1787857186.040310:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037824 00000100:00100000:3.0:1787857186.040350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:3.0:1787857186.040361:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:10509:x1874703863037824:12345-192.168.204.29@tcp:101:lfs.0 00000100:00100000:2.0:1787857186.040368:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1787857186.040378:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:2355:x1874703863037568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857186.040392:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857186.040394:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857186.040418:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbeeef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88297c expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.040421:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeefd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882983 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.040443:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:2.0:1787857186.040450:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857186.040991:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.041023:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.041032:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857186.041048:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787857186.041186:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeefd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882983 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.041203:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882983 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.041211:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:3.0:1787857186.041213:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857186.041216:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044000, rc 0) 00000100:00100000:3.0:1787857186.041368:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:10509:x1874703863037824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1008us (1382us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787857186.041384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:2.0:1787857186.041389:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:2355:x1874703863037568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1010us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.041398:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:0.0:1787857186.052886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.053261:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863037952 00000100:00100000:3.0:1787857186.053273:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863037952 00000100:00100000:3.0:1787857186.053376:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:3.0:1787857186.053388:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863037952:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:3.0:1787857186.053433:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.053454:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.053477:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857186.053482:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787857186.053486:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.053535:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.053549:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 8 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857186.053564:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f4cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874703885073152:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857186.053713:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9457980c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857186.056164:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f4cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874703885073152:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857186.056193:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857186.057553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.057631:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038080 00000100:00100000:0.0:1787857186.057640:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038080 00002000:00100000:0.0:1787857186.057746:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fd981f4cf00 x1874703863038080/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:587/0 lens 504/0 e 0 to 0 dl 1787857197 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857186.057759:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f4cf00 with x1874703863038080 ext(0->8) 00010000:00010000:0.0:1787857186.057767:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 9 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.057804:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 9 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857186.057812:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd981f4cf00 00000100:00100000:0.0:1787857186.057848:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:0.0:1787857186.057858:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863038080:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:0.0:1787857186.059137:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:2352:x1874703863038080:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 1272us (1582us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787857186.059149:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00002000:00100000:0.0:1787857186.059161:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fd981f4cf00 x1874703863038080/t4294967302(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:587/0 lens 504/448 e 0 to 0 dl 1787857197 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857186.059172:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd981f4cf00 with x1874703863038080 ext(0->8) 00010000:00010000:0.0:1787857186.059181:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.059213:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857186.059222:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd981f4cf00 00000100:00100000:1.0:1787857186.063625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.063871:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038208 00000100:00100000:2.0:1787857186.063880:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038208 00010000:00010000:2.0:1787857186.063928:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857186.063970:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:2.0:1787857186.063979:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:2353:x1874703863038208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857186.063992:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787857186.064011:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787857186.064013:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787857185 00002000:00010000:2.0:1787857186.064015:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787857185 00002000:00010000:2.0:1787857186.064017:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787857185 00010000:00010000:2.0:1787857186.064023:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.064035:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.064057:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba173ac0/0xf326646fe3bbeed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88296e expref: 11 pid: 8078 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.064073:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857186.064077:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857186.064083:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.064092:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.064293:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857186.064357:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2353:x1874703863038208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 378us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.064366:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00010000:00010000:3.0:1787857186.064563:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064574:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064614:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064622:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064630:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064638:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857186.064641:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064650:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064758:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.064766:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ec5259/0xf326646fe3bbef12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857186.064816:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863037952:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 11431us (11940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857186.064824:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1787857186.066573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.066644:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038464 00000100:00100000:0.0:1787857186.066653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038464 00000100:00100000:0.0:1787857186.066746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:0.0:1787857186.066755:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d464850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:10509:x1874703863038464:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:0.0:1787857186.066833:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882983 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857186.067110:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787857186.067159:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787857186.067516:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787857186.067577:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.067594:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.067603:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.067649:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.067684:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 42 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.067699:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874703885073280:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857186.067786:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1787857186.069356:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874703885073280:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857186.069381:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857186.069919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.070002:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038592 00000100:00100000:1.0:1787857186.070009:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038592 00010000:00010000:1.0:1787857186.070044:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857186.070141:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:1.0:1787857186.070161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:2352:x1874703863038592:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857186.070176:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857186.070183:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070271:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070353:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbeebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882960 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070369:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857186.070374:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070381:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070386:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.070410:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857186.070517:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.070531:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857186.070800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:2352:x1874703863038592:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 649us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857186.070808:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000001:00080000:0.0:1787857186.071016:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787857186.071315:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787857186.071428:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885073408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787857186.071779:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857186.071866:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885073408 00000100:00100000:2.0:1787857186.071873:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885073408 00000100:00100000:1.0:1787857186.071885:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769b16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857186.071961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857186.071971:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1874703885073408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1787857186.072014:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857186.072107:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1874703885073408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.072114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787857186.072135:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885073408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857186.072539:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787857186.072697:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96de9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885073536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857186.072732:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857186.072754:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94594fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857186.072862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885073536 00000100:00100000:0.0:1787857186.072868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885073536 00000100:00100000:0.0:1787857186.072906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787857186.072913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1874703885073536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787857186.073133:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5839:x1874703885073536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (398us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787857186.073140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857186.073359:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96de9e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885073536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857186.073407:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787857186.073445:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073466:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073474:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073480:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857186.073503:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073515:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073537:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857186.073540:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857186.073544:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.073550:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbef19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857186.073846:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857186.073948:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787857186.073959:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340402297893ns, next at 341402295835ns, rc = 0 00000001:00080000:1.0:1787857186.073964:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787857186.073989:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857186.073991:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857186.073996:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbef04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882983 expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857186.074135:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d464850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:10509:x1874703863038464:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 7380us (7570us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787857186.074144:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000020:00080000:1.0:1787857186.074147:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787857186.075820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.075972:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038720 00000100:00100000:1.0:1787857186.075981:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038720 00000100:00100000:1.0:1787857186.076040:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:1.0:1787857186.076049:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:10509:x1874703863038720:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857186.076071:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857186.076095:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbef20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88298a expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.076159:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbef20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88298a expref: 46 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.076175:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbef20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88298a expref: 46 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.076215:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857186.076219:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857186.076223:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979200, rc 0) 00000100:00100000:1.0:1787857186.076302:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:10509:x1874703863038720:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 253us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857186.076309:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:3.0:1787857186.078408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.078534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863038976 00000100:00100000:2.0:1787857186.078544:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863038976 00000100:00100000:2.0:1787857186.078631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1787857186.078641:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:10509:x1874703863038976:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857186.079029:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10509:x1874703863038976:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 389us (628us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787857186.079039:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1787857186.128560:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.128725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039104 00000100:00100000:0.0:1787857186.128737:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039104 00000100:00100000:0.0:1787857186.128800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:0.0:1787857186.128820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10519:x1874703863039104:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1787857186.128901:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.128919:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.128932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.128960:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.128982:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.128989:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129079:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129087:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129094:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857186.129133:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129145:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129152:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129159:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129167:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857186.129172:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129180:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129198:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857186.129201:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857186.129206:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129213:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129225:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129231:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129235:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129239:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857186.129242:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129248:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd953423200) 00010000:00010000:0.0:1787857186.129255:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857186.129258:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129269:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129293:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129298:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129303:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129306:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857186.129309:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129313:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129320:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.129322:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857186.129325:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.129331:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.129527:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10519:x1874703863039104:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 716us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857186.129535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:0.0:1787857186.145608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.145683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.145717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.145823:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039488 00000100:00100000:3.0:1787857186.145834:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039488 00000100:00100000:3.0:1787857186.145916:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:3.0:1787857186.145927:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863039488:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857186.145970:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039232 00000100:00100000:2.0:1787857186.145976:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039232 00000100:00100000:2.0:1787857186.146011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 283 00000100:00100000:3.0:1787857186.146018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863039488:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857186.146030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:2.0:1787857186.146036:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863039232:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857186.146067:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863039232:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.146075:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 283 00000100:00100000:1.0:1787857186.146652:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039360 00000100:00100000:1.0:1787857186.146680:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039360 00000100:00100000:1.0:1787857186.146726:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1787857186.146734:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2354:x1874703863039360:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857186.146777:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2354:x1874703863039360:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857186.146784:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00080000:0.0:1787857186.148839:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857186.148851:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857186.160098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.160168:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039744 00000100:00100000:1.0:1787857186.160180:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039744 00000100:00100000:1.0:1787857186.160247:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:1.0:1787857186.160258:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:10522:x1874703863039744:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857186.160280:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857186.160301:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882991 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160384:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160401:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160439:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160455:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160462:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160468:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160637:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbef51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160646:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbef51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160653:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbef51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857186.160700:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787857186.160822:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160829:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160837:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.160843:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857186.160853:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161574:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161593:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857186.161596:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857186.161602:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161609:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbef43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161624:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161630:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161636:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161641:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857186.161644:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161650:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.161657:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857186.162244:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857186.162261:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.162269:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbef4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.162337:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882991 expref: 50 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.162353:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbef51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882991 expref: 49 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.162361:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857186.162364:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857186.162367:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979e00, rc 0) 00000100:00100000:1.0:1787857186.162693:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10522:x1874703863039744:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2435us (2606us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787857186.162702:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:3.0:1787857186.166247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.166370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863039872 00000100:00100000:0.0:1787857186.166381:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863039872 00000100:00100000:0.0:1787857186.166474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:0.0:1787857186.167370:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10522:x1874703863039872:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857186.167447:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167478:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167959:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167966:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167973:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167980:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857186.167983:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.167991:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.168119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.168122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857186.169087:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.169101:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.169318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10522:x1874703863039872:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 2831us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857186.169328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 103 00000100:00100000:3.0:1787857186.173062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.173178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863040128 00000100:00100000:1.0:1787857186.173187:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863040128 00000100:00100000:1.0:1787857186.173249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:1.0:1787857186.173264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:10522:x1874703863040128:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:1.0:1787857186.173591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+50:10522:x1874703863040128:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 331us (538us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787857186.173599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00010000:00010000:3.0:1787857186.250455:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857186.252218:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857186.252227:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857186.252261:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787857186.252271:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857186.284593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.284720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863040384 00000100:00100000:3.0:1787857186.284731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863040384 00000100:00100000:3.0:1787857186.284797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:3.0:1787857186.284808:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+50:10532:x1874703863040384:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1787857186.284834:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857186.284838:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787857186.284865:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbeee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882975 expref: 50 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.284886:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857186.284893:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857186.284908:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbef66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882998 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.285000:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbef6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.285039:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbef6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.285050:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbef6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857186.285062:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787857186.285202:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbef66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882998 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.285219:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbef6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882998 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.285228:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857186.285231:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857186.285234:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857186.286031:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10532:x1874703863040384:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1221us (1453us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787857186.286040:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:3.0:1787857186.290114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.290297:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863040640 00000100:00100000:1.0:1787857186.290308:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863040640 00000100:00100000:1.0:1787857186.290452:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 105 00000100:00100000:1.0:1787857186.290463:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10532:x1874703863040640:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:1.0:1787857186.290553:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787857186.290584:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbef6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882998 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.290609:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbef51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882991 expref: 50 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.290620:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857186.290625:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857186.290866:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.290881:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.290890:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857186.290942:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787857186.290967:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000321fe8ea reply state 00000000e8c89917 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857186.290975:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857186.291073:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10532:x1874703863040640:12345-192.168.204.29@tcp:36:bash.0 Request processed in 612us (969us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787857186.291082:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 105 00000020:00080000:1.0:1787857186.291088:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787857186.296236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1787857186.296564:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296577:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296585:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296609:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857186.296615:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296623:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296643:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857186.296646:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857186.296652:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.296685:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbef7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.297298:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863040768 00000100:00100000:0.0:1787857186.297308:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863040768 00000100:00100000:0.0:1787857186.297382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:0.0:1787857186.297391:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:10532:x1874703863040768:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857186.297414:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857186.297431:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa88299f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.297530:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.297544:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.297555:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857186.297585:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787857186.297598:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857186.297621:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.297648:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.298651:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.298676:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.298679:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857186.298682:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857186.298807:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10532:x1874703863040768:12345-192.168.204.29@tcp:101:bash.0 Request processed in 1415us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857186.298815:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 106 00000100:00100000:2.0:1787857186.302767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.302829:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041024 00000100:00100000:3.0:1787857186.302840:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041024 00000100:00100000:3.0:1787857186.302915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:3.0:1787857186.302925:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:10532:x1874703863041024:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1787857186.303159:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:10532:x1874703863041024:12345-192.168.204.29@tcp:35:bash.0 Request processed in 235us (400us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787857186.303167:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:3.0:1787857186.394765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.395231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041152 00000100:00100000:0.0:1787857186.395243:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041152 00000100:00100000:0.0:1787857186.395323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:0.0:1787857186.395421:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:10538:x1874703863041152:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857186.395448:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857186.395471:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829a6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395557:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395572:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395603:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857186.395704:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787857186.395708:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857186.395732:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395761:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbef90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829a6 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395781:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829a6 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.395789:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857186.395792:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857186.395796:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560000, rc 0) 00000100:00100000:0.0:1787857186.395872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863041152:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 454us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857186.395879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 107 00000100:00100000:2.0:1787857186.400172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.400306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041280 00000100:00100000:3.0:1787857186.400316:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041280 00000100:00100000:3.0:1787857186.400389:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:3.0:1787857186.400401:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863041280:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857186.400424:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857186.400459:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbef9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829ad expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400537:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400553:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400567:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400585:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400593:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400600:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400760:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400769:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.400777:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857186.400820:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787857186.400824:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857186.400842:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406418:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406446:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406453:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406461:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406467:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857186.406471:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406478:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406519:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:3.0:1787857186.406523:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857186.406528:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406536:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbefa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406555:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406561:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406595:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406600:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857186.406603:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406610:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406619:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd946159a00) 00010000:00010000:3.0:1787857186.406622:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857186.406626:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406631:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbefac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbef9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406720:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.406726:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857186.406728:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857186.406731:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044000, rc 0) 00000100:00100000:3.0:1787857186.406821:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10538:x1874703863041280:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 6421us (6657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857186.406838:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 108 00000100:00100000:2.0:1787857186.415079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857186.415133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.415232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041536 00000100:00100000:0.0:1787857186.415244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041536 00000100:00100000:0.0:1787857186.415311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:0.0:1787857186.415323:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10538:x1874703863041536:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857186.415363:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857186.415401:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829b4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415548:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415565:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415574:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415583:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415617:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415631:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.415644:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885073664:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857186.415801:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.415810:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.415820:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885073792:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857186.415854:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97fa06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857186.416103:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041664 00000100:00100000:3.0:1787857186.416109:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041664 00010000:00010000:3.0:1787857186.416140:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 57 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857186.416175:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1787857186.416184:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:2355:x1874703863041664:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857186.416195:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857186.416202:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 57 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.416214:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 57 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.416234:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857186.416239:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.416245:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.416252:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857186.416279:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:2355:x1874703863041664:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 97us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857186.416287:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:1.0:1787857186.425189:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:0.0:1787857186.425657:0:5838:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.29@tcp) returned -22 from blocking AST (req@00000000e5551f13 x1874703885073664) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.425772:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbefb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ad expref: 56 pid: 5836 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857186.425816:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885073664:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857186.425855:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885073792:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857186.425880:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.425886:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.425896:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.425905:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857186.426540:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863041792 00000100:00100000:2.0:1787857186.426548:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863041792 00010000:00010000:2.0:1787857186.426601:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857186.426641:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:2.0:1787857186.426652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:2353:x1874703863041792:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857186.426705:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857186.426711:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426723:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbef89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88299f expref: 56 pid: 5838 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426780:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:2.0:1787857186.426784:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426804:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426813:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857186.426836:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857186.426902:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:2353:x1874703863041792:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 252us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857186.426910:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00010000:00010000:0.0:1787857186.427197:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.427205:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857186.427226:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787857186.427394:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.427421:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.427429:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.427431:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857186.427434:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857186.427463:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10538:x1874703863041536:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 12144us (12396us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787857186.427470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 109 00000100:00100000:2.0:1787857186.434114:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857186.434260:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042048 00000100:00100000:1.0:1787857186.434270:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042048 00000100:00100000:1.0:1787857186.434355:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857186.434366:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10538:x1874703863042048:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:1.0:1787857186.434382:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857186.434407:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbef20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88298a expref: 55 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857186.434427:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857186.434433:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857186.434534:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863042048:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 169us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857186.434555:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857186.443713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857186.444167:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042176 00000100:00100000:3.0:1787857186.444192:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042176 00000100:00100000:3.0:1787857186.444249:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:3.0:1787857186.444258:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863042176:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:3.0:1787857186.444369:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.444389:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857186.444402:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857186.444637:0:8075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787857186.444790:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863042176:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 531us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857186.446351:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 110 00000100:00100000:3.0:1787857186.453212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857186.462009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042304 00000100:00100000:0.0:1787857186.462025:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042304 00000100:00100000:0.0:1787857186.462134:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 111 00000100:00100000:0.0:1787857186.462181:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+54:10538:x1874703863042304:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857186.462218:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857186.462255:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829bb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462341:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462385:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462420:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462459:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462507:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857186.462511:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857186.462543:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857186.462552:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560e00, rc 0) 00000100:00100000:0.0:1787857186.464447:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10538:x1874703863042304:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 2264us (11222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857186.464460:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 111 00000040:00080000:2.0:1787857187.271923:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857187.271933:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857187.271987:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787857187.271997:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857187.272124:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885073920:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857187.272236:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3300 going to sleep for 11 seconds 00010000:00010000:3.0:1787857187.274605:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857187.275955:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885073920:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857187.284810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.285097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042432 00000100:00100000:0.0:1787857187.285107:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042432 00000100:00100000:0.0:1787857187.285188:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00100000:0.0:1787857187.285198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10540:x1874703863042432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857187.285227:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857187.285356:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10540:x1874703863042432:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 160us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.285365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 112 00000100:00080000:3.0:1787857187.285465:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857187.289865:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.290156:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042560 00000100:00100000:0.0:1787857187.290166:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042560 00000100:00100000:0.0:1787857187.290227:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:0.0:1787857187.290237:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10540:x1874703863042560:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.290308:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290326:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290350:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290407:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290415:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290421:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290444:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290453:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290459:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857187.290506:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787857187.290511:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857187.290523:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290534:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290541:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290557:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290563:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.290567:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290586:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290597:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:0.0:1787857187.290600:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.290604:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290610:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbefdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290624:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290629:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290634:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290640:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.290642:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290657:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290948:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fd953423200) 00010000:00010000:0.0:1787857187.290950:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.290954:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290960:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbefe4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290976:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290983:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290989:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.290993:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.290995:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.291002:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.291008:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857187.291010:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.291013:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.291030:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbefeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857187.291112:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10540:x1874703863042560:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 876us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.291120:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 113 00000100:00100000:2.0:1787857187.301172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.301439:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042816 00000100:00100000:3.0:1787857187.301449:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042816 00000100:00100000:3.0:1787857187.301525:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:3.0:1787857187.301535:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:10540:x1874703863042816:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857187.301554:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857187.301576:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829c2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.301706:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.301735:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.301746:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857187.301757:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787857187.302332:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302342:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302349:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302355:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857187.302359:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302366:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302378:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857187.302381:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857187.302385:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302392:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbeff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302542:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeff2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829c2 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302561:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:3.0:1787857187.302563:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857187.302568:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbeff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829c2 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.302579:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857187.302649:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863042816:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1114us (1485us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787857187.302656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 114 00000100:00100000:2.0:1787857187.308064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.308310:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863042944 00000100:00100000:1.0:1787857187.308329:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863042944 00000100:00100000:1.0:1787857187.308392:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:1.0:1787857187.308405:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863042944:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857187.308442:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857187.308556:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863042944:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 154us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.308564:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:1.0:1787857187.314244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.314357:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863043200 00000100:00100000:0.0:1787857187.314368:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863043200 00000100:00100000:0.0:1787857187.314445:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1787857187.314456:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863043200:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.314492:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857187.314495:0:8856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787857187.314528:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbef97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829a6 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.314550:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857187.314556:0:8856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857187.314570:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829c9 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787857187.315389:0:8856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787857187.315649:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf00e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.317484:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf00e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.317506:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf00e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.318050:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829c9 expref: 58 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.318073:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf00e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829c9 expref: 57 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.318084:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857187.318087:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857187.318091:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560c00, rc 0) 00000100:00100000:0.0:1787857187.318174:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:10540:x1874703863043200:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 3719us (3942us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787857187.318184:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:2.0:1787857187.328424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.328624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863043456 00000100:00100000:0.0:1787857187.328634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863043456 00000100:00100000:0.0:1787857187.328702:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:0.0:1787857187.328714:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:10540:x1874703863043456:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.328773:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857187.328813:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf00e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829c9 expref: 57 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.328833:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423200) 00010000:00010000:0.0:1787857187.328970:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857187.328994:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329008:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329033:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329085:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329093:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329099:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329176:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329184:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329190:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329197:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.329200:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329207:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329215:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857187.329218:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.329221:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329234:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf01c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329244:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329249:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329255:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329259:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.329262:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329268:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329275:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfc288813 (ffff9fd953423000) 00010000:00010000:0.0:1787857187.329278:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.329280:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.329286:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfc288813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857187.329371:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863043456:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 659us (957us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857187.329379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:2.0:1787857187.337367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.337442:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863043584 00000100:00100000:0.0:1787857187.337452:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863043584 00000100:00100000:0.0:1787857187.337529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1787857187.337539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:10540:x1874703863043584:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.337560:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857187.337582:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf02a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829d0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337623:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337649:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337810:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf02a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337829:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.337838:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:0.0:1787857187.337841:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857187.337845:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561e00, rc 0) 00000100:00100000:0.0:1787857187.338200:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:10540:x1874703863043584:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 660us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.338208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:3.0:1787857187.349751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.350372:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863043840 00000100:00100000:0.0:1787857187.350383:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863043840 00000100:00100000:0.0:1787857187.350963:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:0.0:1787857187.350976:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:10540:x1874703863043840:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.351074:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.351091:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.351105:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857187.351379:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787857187.351391:0:8856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341679729834ns, next at 342679726577ns, rc = 0 00000004:00010000:0.0:1787857187.351496:0:8856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065397fb4 reply state 000000008bafde47 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857187.351506:0:8856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857187.351810:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+59:10540:x1874703863043840:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 835us (2069us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787857187.351818:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00010000:00010000:1.0:1787857187.354320:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354338:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354364:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354370:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857187.354376:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354383:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354399:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:1.0:1787857187.354402:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787857187.354406:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.354412:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.356847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.356891:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863043968 00000100:00100000:1.0:1787857187.356900:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863043968 00000100:00100000:1.0:1787857187.356966:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:1.0:1787857187.356977:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+58:10540:x1874703863043968:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857187.357003:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857187.357025:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829d7 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.357099:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 59 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.357136:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 59 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.357157:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:1.0:1787857187.357160:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857187.357164:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978200, rc 0) 00000100:00100000:1.0:1787857187.357225:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+59:10540:x1874703863043968:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 250us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.357233:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:3.0:1787857187.363964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.364057:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863044096 00000100:00100000:0.0:1787857187.364068:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863044096 00000100:00100000:0.0:1787857187.364128:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1787857187.364138:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863044096:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787857187.364448:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863044096:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 310us (495us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787857187.364456:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1787857187.372747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.373026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863044352 00000100:00100000:1.0:1787857187.373037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863044352 00000100:00100000:1.0:1787857187.373103:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:1.0:1787857187.373113:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+59:10540:x1874703863044352:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857187.373377:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:10540:x1874703863044352:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 265us (641us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787857187.373385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:1.0:1787857187.376379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.376465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863044608 00000100:00100000:3.0:1787857187.376485:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863044608 00000100:00100000:3.0:1787857187.376595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:3.0:1787857187.376607:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:10540:x1874703863044608:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857187.376749:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:10540:x1874703863044608:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 145us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857187.376757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:2.0:1787857187.382107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.382833:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863044736 00000100:00100000:1.0:1787857187.382845:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863044736 00000100:00100000:1.0:1787857187.383587:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:1.0:1787857187.383597:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:10540:x1874703863044736:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857187.383616:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857187.383637:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbf046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829de expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.383901:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.383915:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.383926:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857187.383959:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857187.383978:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.384004:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979000/0xf326646fe3bbf046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829de expref: 62 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.384021:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829de expref: 61 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.384029:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:1.0:1787857187.384031:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857187.384035:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979a00, rc 0) 00000100:00100000:1.0:1787857187.384102:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:10540:x1874703863044736:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 506us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.384110:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 122 00000100:00100000:1.0:1787857187.386839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.386980:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863044864 00000100:00100000:2.0:1787857187.386990:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863044864 00000100:00100000:2.0:1787857187.387047:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:2.0:1787857187.387059:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863044864:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857187.387077:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857187.387101:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829e5 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857187.387198:0:8078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908922, blocks: 0x1 00010000:00010000:2.0:1787857187.387220:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787857187.387225:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857187.387235:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 10 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.387321:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 10 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.387335:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85800, rc 0) 00000100:00100000:2.0:1787857187.387466:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2353:x1874703863044864:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 408us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857187.387483:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:3.0:1787857187.392769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.393326:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045120 00000100:00100000:0.0:1787857187.393337:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045120 00000100:00100000:0.0:1787857187.393401:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:0.0:1787857187.393410:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:10540:x1874703863045120:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857187.393590:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:10540:x1874703863045120:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 179us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.393597:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 123 00000100:00100000:3.0:1787857187.403331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.403558:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045248 00000100:00100000:1.0:1787857187.403567:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045248 00000100:00100000:1.0:1787857187.403645:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:1.0:1787857187.403653:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:10540:x1874703863045248:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857187.403702:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857187.403719:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829ec expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.403752:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.403762:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857187.403767:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857187.403773:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.403809:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.403822:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.403836:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96de9da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885074048:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857187.404247:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857187.411579:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96de9da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1874703885074048:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857187.411621:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.411651:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979800, rc 0) 00000100:00100000:0.0:1787857187.411763:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:10540:x1874703863045248:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 8109us (8438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.411781:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1787857187.413067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.413497:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045376 00000100:00100000:3.0:1787857187.413506:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045376 00010000:00010000:3.0:1787857187.413562:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.413618:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:3.0:1787857187.413628:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:2353:x1874703863045376:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857187.413642:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857187.413689:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.414108:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.414135:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002314a70d/0xf326646fe3bbf054 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829e5 expref: 11 pid: 8078 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.414151:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857187.414155:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857187.414164:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.414175:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.414229:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.414244:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b5352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885074176:192.168.204.29@tcp:105: 00000100:00100000:3.0:1787857187.418319:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857187.419193:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b5352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885074176:192.168.204.29@tcp:105: 00010000:00010000:3.0:1787857187.419218:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857187.419277:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2353:x1874703863045376:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 5651us (6215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857187.419288:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:1.0:1787857187.430261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.430344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045504 00000100:00100000:3.0:1787857187.430356:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045504 00002000:00100000:3.0:1787857187.430407:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fd96de9e580 x1874703863045504/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:588/0 lens 504/0 e 0 to 0 dl 1787857198 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857187.430418:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd96de9e580 with x1874703863045504 ext(0->12) 00002000:00010000:3.0:1787857187.430424:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd96de9e580 00000100:00100000:3.0:1787857187.430475:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857187.430486:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863045504:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857187.431034:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:2352:x1874703863045504:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 548us (781us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787857187.431043:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00002000:00100000:3.0:1787857187.431050:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fd96de9e580 x1874703863045504/t4294967308(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:588/0 lens 504/448 e 0 to 0 dl 1787857198 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857187.431059:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd96de9e580 with x1874703863045504 ext(0->12) 00002000:00010000:3.0:1787857187.431063:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd96de9e580 00000100:00100000:2.0:1787857187.434308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.434412:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045632 00000100:00100000:3.0:1787857187.434422:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045632 00000100:00100000:3.0:1787857187.434714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:3.0:1787857187.434727:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:10540:x1874703863045632:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787857187.471542:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787857187.471556:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787857187.471600:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd97f9ac900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787857187.471618:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd945c2b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97f9ac9c0 00000020:00080000:1.0:1787857187.471621:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd945c2bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd9482c3000 00000001:00080000:1.0:1787857187.471646:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787857187.471678:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787857187.471693:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd97f9ac600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787857187.471696:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd97f9f9700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd9465166c0 00000020:00080000:1.0:1787857187.471699:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd97f9f9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd981f41c00 00000100:00100000:1.0:1787857187.471875:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10540:x1874703863045632:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 37147us (37573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.471887:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 124 00000100:00100000:1.0:1787857187.472614:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885074304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857187.472717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.472764:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd947e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885074560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857187.472808:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.472832:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857187.472838:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885074432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787857187.472859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.472892:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885074304 00000100:00100000:1.0:1787857187.472898:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885074304 00000100:00100000:1.0:1787857187.472939:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885074560 00000100:00100000:1.0:1787857187.472942:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885074560 00000100:00100000:1.0:1787857187.472965:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885074432 00000100:00100000:1.0:1787857187.472968:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885074432 00000100:00100000:1.0:1787857187.472982:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787857187.472990:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874703885074304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787857187.473015:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787857187.473063:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a908921, atime: 0x6a908921, ctime: 0x6a908921, blocks: 0x1 00010000:00010000:1.0:1787857187.473072:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.473092:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787857187.473097:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857187.473103:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.473120:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.473130:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.473137:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.473154:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857187.473284:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857187.473300:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885074560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857187.473462:0:8078:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787857187.473476:0:8078:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787857186 00002000:00010000:2.0:1787857187.473478:0:8078:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857187.473481:0:8078:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787857186 -> 1787857186 00002000:00010000:2.0:1787857187.473483:0:8078:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857187.473534:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b64e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874703885074560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (725us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787857187.473542:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857187.473559:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787857187.473565:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885074432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787857187.473576:0:8078:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787857187.473588:0:8078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.473603:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 11 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.473611:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787857187.473614:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857187.473618:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.473643:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 11 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.473677:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 11 pid: 8078 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.473697:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fde7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885074688:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857187.473754:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd947cf60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857187.475086:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3312:x1874703885074304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2092us (2364us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787857187.475095:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787857187.475251:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857187.475259:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.475269:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857187.475284:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.475295:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.475313:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.475320:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cda30a0/0xf326646fe3bbf062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.475338:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857187.475340:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857187.475341:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857187.475375:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd947e792c0/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787857187.475381:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd947e792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885074560:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787857187.475564:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787857187.475754:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:3.0:1787857187.476203:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787857187.476578:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd9602b12c0/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787857187.476586:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885074304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857187.478744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.478913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.479037:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045888 00000100:00100000:1.0:1787857187.479046:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045888 00010000:00010000:1.0:1787857187.479087:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 12 pid: 8078 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.479129:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:1.0:1787857187.479140:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:2352:x1874703863045888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857187.479156:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857187.479161:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 12 pid: 8078 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.479205:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 12 pid: 8078 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.479235:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857187.479240:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857187.479246:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.479256:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.479278:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857187.479336:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:2352:x1874703863045888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 198us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.479344:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00010000:00010000:3.0:1787857187.480145:0:8078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084321869/0xf326646fe3bbee24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88294b expref: 11 pid: 8078 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.480164:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fde7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885074688:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857187.480198:0:8078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.480210:0:8078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.480218:0:8078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.480229:0:8078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.480238:0:8078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.480258:0:8078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857187.481070:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874703885074432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7502us (8206us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787857187.481078:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787857187.481103:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863045760 00000100:00100000:3.0:1787857187.481108:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863045760 00010000:00010000:1.0:1787857187.481204:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857187.481212:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.481222:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857187.481227:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.481238:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.481267:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.481275:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab451234/0xf326646fe3bbf069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.481294:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857187.481296:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857187.481297:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787857187.481337:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd9769d9680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787857187.481343:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9769d9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885074432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787857187.482140:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1787857187.482805:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:2353:x1874703863045760:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787857187.525379:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787857187.525399:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787857187.525407:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787857187.525412:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1787857187.525629:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863045760:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 43471us (46885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857187.525641:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:3.0:1787857187.527780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.527944:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046144 00000100:00100000:1.0:1787857187.527956:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046144 00000100:00100000:1.0:1787857187.528017:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 125 00000100:00100000:1.0:1787857187.528027:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10540:x1874703863046144:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787857187.528085:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857187.528114:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf04d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829de expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.528132:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:1.0:1787857187.528138:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857187.528168:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.528293:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.528324:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857187.528701:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001357b522 reply state 00000000b64fec8a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.528720:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857187.528814:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:10540:x1874703863046144:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 788us (1051us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787857187.528823:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 125 00010000:00010000:3.0:1787857187.531431:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531447:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531455:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531461:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857187.531474:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531482:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531499:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:3.0:1787857187.531502:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857187.531507:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.531513:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf070 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.536873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.537204:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046272 00000100:00100000:0.0:1787857187.537213:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046272 00000100:00100000:0.0:1787857187.537269:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:0.0:1787857187.537280:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b535680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863046272:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787857187.537596:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787857187.537600:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787857186 -> 1787857185 00002000:00010000:0.0:1787857187.537602:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787857185 00002000:00010000:0.0:1787857187.537604:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787857186 -> 1787857185 00002000:00010000:0.0:1787857187.537606:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787857187.537698:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b535680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863046272:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 419us (835us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787857187.537708:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:1.0:1787857187.540203:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.540456:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046528 00000100:00100000:2.0:1787857187.540474:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046528 00000100:00100000:2.0:1787857187.540651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:2.0:1787857187.540683:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10540:x1874703863046528:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787857187.540748:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.540765:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.540775:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.540810:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.540824:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 15 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.540852:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fde6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885074816:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857187.540934:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94594fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857187.544490:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fde6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885074816:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857187.544989:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.546360:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.546974:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046656 00000100:00100000:3.0:1787857187.546984:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046656 00010000:00010000:3.0:1787857187.547038:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 16 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.547086:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1787857187.547097:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:2353:x1874703863046656:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857187.547115:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857187.547121:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 16 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547136:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 16 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547160:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d0 expref: 16 pid: 5837 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547176:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:3.0:1787857187.547182:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547191:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547198:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.547228:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857187.547267:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547276:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547304:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547311:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547317:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547322:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857187.547326:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547332:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547341:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:2.0:1787857187.547359:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857187.547365:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.547371:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf077 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.547894:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2353:x1874703863046656:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 794us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857187.547903:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:2.0:1787857187.551117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10540:x1874703863046528:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 10441us (10907us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857187.551143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 126 00000100:00100000:1.0:1787857187.554225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.554436:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046784 00000100:00100000:0.0:1787857187.554446:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046784 00000100:00100000:0.0:1787857187.554629:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:0.0:1787857187.554641:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863046784:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857187.554742:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.554765:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.554898:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857187.554902:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857187.554907:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.554942:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.554974:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 7 pid: 6676 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857187.554989:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874703885074944:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857187.555109:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9496cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857187.559249:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b1680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874703885074944:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857187.559277:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.559631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.559826:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863046912 00000100:00100000:2.0:1787857187.559833:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863046912 00010000:00010000:2.0:1787857187.559920:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 8 pid: 6676 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.559996:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:2.0:1787857187.560007:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863046912:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857187.560021:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857187.560044:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 8 pid: 6676 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.560057:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 8 pid: 6676 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.560079:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4abb741/0xf326646fe3bbf05b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829ec expref: 8 pid: 6676 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.560094:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857187.560112:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857187.560117:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.560128:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.560158:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857187.560205:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560215:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560238:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560247:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.560249:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863046912:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 244us (619us total) trans 0 rc 0/0 00010000:00010000:0.0:1787857187.560255:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.560257:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00010000:00010000:0.0:1787857187.560273:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857187.560277:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560286:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560298:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.560305:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf07e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857187.560360:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863046784:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 5710us (6132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.560367:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1787857187.563167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.563269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863047168 00000100:00100000:3.0:1787857187.563278:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863047168 00000100:00100000:3.0:1787857187.563338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 127 00000100:00100000:3.0:1787857187.563349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10540:x1874703863047168:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857187.563435:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.563454:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.563475:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.564029:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.564043:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.564052:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.564084:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.564097:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 15 pid: 8075 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857187.564111:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b537840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885075072:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857187.564192:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942fadc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857187.568341:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b537840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885075072:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857187.568370:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.568569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.568642:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863047296 00000100:00100000:2.0:1787857187.568649:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863047296 00010000:00010000:2.0:1787857187.568724:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 16 pid: 8075 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.568756:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:2.0:1787857187.568765:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:2353:x1874703863047296:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857187.568787:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857187.568795:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 16 pid: 8075 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568807:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 16 pid: 8075 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568829:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf03f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829d7 expref: 16 pid: 8075 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568872:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:2.0:1787857187.568877:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568886:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568895:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.568923:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857187.568977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2353:x1874703863047296:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 213us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857187.568984:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00010000:00010000:1.0:1787857187.570057:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.570068:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857187.570268:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787857187.570444:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787857187.570504:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787857187.570597:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885075200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857187.570650:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.570713:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9452f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857187.571161:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885075200 00000100:00100000:3.0:1787857187.571168:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885075200 00000100:00100000:3.0:1787857187.571222:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787857187.571242:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874703885075200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857187.571321:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874703885075200:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857187.571329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857187.572125:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787857187.572145:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787857187.572162:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd947e792c0, transno 4294967309 00000004:00080000:1.0:1787857187.572178:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd9769d9680, transno 4294967310 00000100:00100000:1.0:1787857187.572185:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885075200:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787857187.573499:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787857187.573622:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885075328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857187.573705:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.573744:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857187.574011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885075328 00000100:00100000:3.0:1787857187.574019:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885075328 00000100:00100000:3.0:1787857187.574076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787857187.574085:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1874703885075328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857187.574279:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1874703885075328:12345-0@lo:1000:mdt00_000.0 Request processed in 195us (572us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787857187.574286:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857187.574634:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd952a97840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885075328:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787857187.574695:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574706:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574713:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574719:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857187.574724:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574731:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574747:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423b00) 00010000:00010000:1.0:1787857187.574750:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857187.574754:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574784:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf08c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574814:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574820:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574826:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.574830:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857187.575014:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.575022:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.575030:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857187.575033:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857187.575039:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.575049:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.575057:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857187.575094:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.575106:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885075456:192.168.204.29@tcp:105: 00000100:00100000:1.0:1787857187.575202:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857187.579425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.579702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863047424 00000100:00100000:2.0:1787857187.579711:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863047424 00000100:00100000:2.0:1787857187.579761:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:2.0:1787857187.579957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10538:x1874703863047424:12345-192.168.204.29@tcp:49:lfs.0 00000100:00100000:2.0:1787857187.580084:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10538:x1874703863047424:12345-192.168.204.29@tcp:49:lfs.0 Request processed in 315us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857187.580092:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:3.0:1787857187.581883:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ada40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885075456:192.168.204.29@tcp:105: 00010000:00010000:3.0:1787857187.582131:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582143:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbefcf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582197:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582212:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.582227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1787857187.582240:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582254:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582261:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582268:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582274:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857187.582278:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582285:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582297:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857187.582300:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857187.582304:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582308:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf093 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582320:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582326:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.582331:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863047680 00000100:00100000:1.0:1787857187.582339:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863047680 00010000:00010000:3.0:1787857187.582342:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582349:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857187.582352:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582359:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582368:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:3.0:1787857187.582371:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857187.582374:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.582380:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.582393:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 128 00000100:00100000:1.0:1787857187.582403:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10538:x1874703863047680:12345-192.168.204.29@tcp:58:lfs.0 00000100:00100000:3.0:1787857187.582638:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10540:x1874703863047168:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 19290us (19479us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787857187.582647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 127 00000020:00080000:3.0:1787857187.582652:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787857187.582762:0:8075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787857187.582812:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+18:10538:x1874703863047680:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 410us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.582819:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 128 00000040:00080000:2.0:1787857187.583036:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857187.583040:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857187.583065:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787857187.583071:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857187.583154:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fde7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885075584:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857187.583203:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857187.587380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.587495:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fde7c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885075584:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857187.593487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.593817:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863048064 00000100:00100000:0.0:1787857187.593828:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863048064 00000100:00100000:1.0:1787857187.593883:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863047808 00000100:00100000:1.0:1787857187.593888:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863047808 00000100:00100000:0.0:1787857187.593897:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:0.0:1787857187.593909:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d466c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:10540:x1874703863048064:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787857187.594906:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787857187.595017:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787857187.595067:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.595093:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.595105:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.595114:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.596968:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.596978:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.597057:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787857187.597194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d466c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:10540:x1874703863048064:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 3283us (3710us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787857187.597204:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000020:00080000:0.0:1787857187.597210:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787857187.597324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:0.0:1787857187.597334:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:10541:x1874703863047808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857187.597367:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857187.597439:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:10541:x1874703863047808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 107us (10077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.597446:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00010000:00010000:3.0:1787857187.600804:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857187.600822:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.600838:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857187.600842:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.600875:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.600899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fd953423600) 00010000:00010000:3.0:1787857187.600902:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787857187.600907:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.600912:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf09a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.602755:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857187.602761:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857187.602764:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857187.605148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857187.605480:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863048320 00000100:00100000:3.0:1787857187.605491:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863048320 00000100:00100000:3.0:1787857187.605581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:3.0:1787857187.605591:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fde7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:10541:x1874703863048320:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857187.605620:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857187.605641:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf0a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829f3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.605797:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf0a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.605814:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857187.605829:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf0a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857187.606214:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787857187.606974:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf0a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829f3 expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.607011:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf0a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829f3 expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.607020:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857187.607023:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857187.607027:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044000, rc 0) 00000100:00100000:0.0:1787857187.607130:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fde7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:10541:x1874703863048320:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1539us (1990us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787857187.607138:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:0.0:1787857187.615978:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.616226:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863048576 00000100:00100000:2.0:1787857187.616245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863048576 00000100:00100000:2.0:1787857187.616308:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 131 00000100:00100000:2.0:1787857187.616318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:10541:x1874703863048576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857187.616409:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616428:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616440:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616680:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616689:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616695:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616701:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857187.616720:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616728:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616740:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:2.0:1787857187.616743:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857187.616747:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.616754:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.617180:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:10541:x1874703863048576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 861us (1520us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787857187.617188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 131 00000040:00080000:3.0:1787857187.618350:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857187.618356:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857187.619128:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787857187.619140:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857187.620091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857187.620163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863048832 00000100:00100000:1.0:1787857187.620172:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863048832 00000100:00100000:1.0:1787857187.620225:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857187.620245:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:10541:x1874703863048832:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787857187.620731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:10541:x1874703863048832:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 496us (645us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787857187.620740:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:1.0:1787857187.627767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.628007:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863048960 00000100:00100000:2.0:1787857187.628017:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863048960 00000100:00100000:2.0:1787857187.628179:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 132 00000100:00100000:2.0:1787857187.628191:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:10543:x1874703863048960:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857187.628215:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857187.628238:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa8829fa expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628303:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628318:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628345:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628360:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628367:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628374:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628752:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628764:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628773:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628805:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.628819:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 25 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.628844:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96ddd6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885075712:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857187.628946:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857187.633598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857187.634045:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96ddd6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885075712:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857187.634073:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857187.634930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049216 00000100:00100000:1.0:1787857187.634959:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049216 00000100:00100000:1.0:1787857187.635018:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:1.0:1787857187.635028:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:5591:x1874703863049216:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787857187.636314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:5591:x1874703863049216:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 1281us (2719us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787857187.636326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:0.0:1787857187.642218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857187.642321:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049344 00000100:00100000:2.0:1787857187.642331:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049344 00010000:00010000:2.0:1787857187.642420:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 27 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857187.642495:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:2.0:1787857187.642506:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:2353:x1874703863049344:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857187.642534:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857187.642542:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 27 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642557:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 27 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642581:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbefc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829b4 expref: 27 pid: 5838 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642597:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:2.0:1787857187.642602:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642612:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642620:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857187.642649:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857187.642753:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:2353:x1874703863049344:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857187.642761:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00010000:00010000:0.0:1787857187.642984:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.642992:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857187.643598:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787857187.643603:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857187.643622:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643636:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643690:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643698:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643705:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643711:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.643716:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643722:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643733:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:0.0:1787857187.643736:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.643740:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643747:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf0c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643760:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643766:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643781:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643795:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857187.643798:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643804:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643813:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fd949362000) 00010000:00010000:0.0:1787857187.643815:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857187.643818:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643824:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf0cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643858:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829fa expref: 26 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643873:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829fa expref: 25 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857187.643881:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857187.643883:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857187.643886:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85400, rc 0) 00000100:00100000:0.0:1787857187.643929:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:10543:x1874703863048960:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 15741us (16172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.643937:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 132 00000100:00100000:2.0:1787857187.655936:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885075840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857187.656012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.656625:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885076224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.656685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.656708:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857187.656714:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885076096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.656737:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.656767:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885076352:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.656789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857187.656803:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857187.656808:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885075968:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.656834:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857187.656872:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885075840 00000100:00100000:1.0:1787857187.656872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885075968 00000100:00100000:3.0:1787857187.656880:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885075840 00000100:00100000:1.0:1787857187.656880:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885075968 00000100:00100000:3.0:1787857187.656919:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857187.656919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787857187.656927:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885075840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857187.656927:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885075968:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787857187.656945:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787857187.656975:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885075840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.656975:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3311:x1874703885075968:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857187.656982:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787857187.656983:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787857187.657030:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885075968:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.657049:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885075840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857187.657089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076224 00000100:00100000:1.0:1787857187.657093:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076224 00000100:00100000:1.0:1787857187.657131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076096 00000100:00100000:1.0:1787857187.657135:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076096 00000100:00100000:1.0:1787857187.657150:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076352 00000100:00080000:3.0:1787857187.657151:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857187.657152:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076352 00000100:00080000:3.0:1787857187.657173:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857187.657174:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787857187.657180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885076224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.657222:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885076224:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857187.657228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787857187.657360:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885076224:0@lo:400:kworker.0 00000100:00100000:0.0:1787857187.658483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787857187.658501:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885076096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857187.658581:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885076096:12345-0@lo:400:kworker.0 Request processed in 83us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.658587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787857187.658607:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787857187.658614:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885076352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857187.658646:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885076352:12345-0@lo:400:kworker.0 Request processed in 33us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857187.658652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787857187.660050:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885076096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857187.662839:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885076352:0@lo:400:kworker.0 00000001:00080000:0.0:1787857187.748054:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787857187.748071:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787857187.748218:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1787857188.298260:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857188.334817:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857188.334826:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857188.334872:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787857188.334879:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857188.474571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857188.474750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049600 00000100:00100000:1.0:1787857188.474760:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049600 00000100:00100000:1.0:1787857188.474817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:1.0:1787857188.474827:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b537840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:10566:x1874703863049600:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857188.474852:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857188.474873:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf0d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a01 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857188.474972:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbf0e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857188.475002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbf0e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857188.475014:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbf0e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857188.475028:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787857188.475162:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf0d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a01 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857188.475180:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbf0e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a01 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857188.475188:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857188.475191:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857188.475195:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979400, rc 0) 00000100:00100000:1.0:1787857188.475248:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b537840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10566:x1874703863049600:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 422us (686us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787857188.475254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 133 00000100:00100000:2.0:1787857188.481197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857188.481267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049728 00000100:00100000:0.0:1787857188.481277:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049728 00000100:00100000:0.0:1787857188.481343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:0.0:1787857188.481355:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10566:x1874703863049728:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857188.481422:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481440:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481463:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481489:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481496:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481512:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481518:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857188.481522:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481530:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481541:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:0.0:1787857188.481544:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857188.481549:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.481556:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561e00/0xf326646fe3bbf0ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857188.481631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:10566:x1874703863049728:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 279us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857188.481639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:3.0:1787857188.568155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857188.570852:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049856 00000100:00100000:0.0:1787857188.570869:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049856 00000100:00100000:0.0:1787857188.570950:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:0.0:1787857188.570960:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b535e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2354:x1874703863049856:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1787857188.570979:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857188.571000:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba173ac0/0xf326646fe3bbf0f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a08 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857188.571044:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a908921, atime: 0x6a908921, ctime: 0x6a908921, blocks: 0xb 00010000:00010000:0.0:1787857188.571066:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1787857188.571071:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857188.571080:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba173ac0/0xf326646fe3bbf0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a08 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.571098:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba173ac0/0xf326646fe3bbf0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a08 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857188.571112:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561e00, rc 0) 00000100:00100000:0.0:1787857188.571181:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b535e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2354:x1874703863049856:12345-192.168.204.29@tcp:101:cat.0 Request processed in 221us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857188.571187:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00080000:3.0:1787857188.571576:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857188.587969:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857188.589811:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863049984 00000100:00100000:1.0:1787857188.590080:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863049984 00002000:00100000:1.0:1787857188.590144:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fd947e7bc00 x1874703863049984/t0(0) o3->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:589/0 lens 488/0 e 0 to 0 dl 1787857199 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857188.590159:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd947e7bc00 with x1874703863049984 ext(0->4095) 00002000:00010000:1.0:1787857188.590164:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd947e7bc00 00000100:00100000:1.0:1787857188.590195:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:1.0:1787857188.590205:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2354:x1874703863049984:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:1.0:1787857188.590540:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2354:x1874703863049984:12345-192.168.204.29@tcp:3:cat.0 Request processed in 335us (2578us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787857188.590548:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00002000:00100000:1.0:1787857188.590556:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fd947e7bc00 x1874703863049984/t0(0) o3->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:589/0 lens 488/4536 e 0 to 0 dl 1787857199 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787857188.590565:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd947e7bc00 with x1874703863049984 ext(0->4095) 00002000:00010000:1.0:1787857188.590568:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd947e7bc00 00000100:00100000:0.0:1787857188.681343:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885076480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857188.681422:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857188.681628:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076480 00000100:00100000:3.0:1787857188.681636:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076480 00000100:00100000:3.0:1787857188.681729:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857188.681739:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885076480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857188.681790:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857188.681851:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885076480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857188.681858:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787857188.681912:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787857188.681918:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1787857188.681937:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd96d8ac780, transno 4294967301 00000004:00080000:3.0:1787857188.681947:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787857188.681959:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd9602b12c0, transno 4294967304 00000100:00100000:3.0:1787857188.681971:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885076480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787857188.683795:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787857189.325609:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857190.359250:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857191.267611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857191.267697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857191.268188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050112 00000100:00100000:0.0:1787857191.268196:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050112 00000100:00100000:0.0:1787857191.268237:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 285 00000100:00100000:0.0:1787857191.268243:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863050112:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857191.268312:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2354:x1874703863050112:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 69us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857191.268317:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 285 00000100:00100000:0.0:1787857191.268462:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050368 00000100:00100000:0.0:1787857191.268467:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050368 00000100:00100000:0.0:1787857191.268510:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:0.0:1787857191.268517:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863050368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857191.268547:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e79a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2354:x1874703863050368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857191.268554:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00080000:0.0:1787857191.268570:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857191.270281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857191.270367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857191.270501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857191.270546:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050624 00000100:00100000:1.0:1787857191.270554:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050624 00000100:00080000:3.0:1787857191.270633:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857191.270646:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050496 00000100:00100000:2.0:1787857191.270652:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050496 00000100:00080000:3.0:1787857191.270716:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857191.270733:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:2.0:1787857191.270743:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2354:x1874703863050496:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857191.270754:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050240 00000100:00100000:0.0:1787857191.270760:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050240 00000100:00100000:0.0:1787857191.270798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:2.0:1787857191.270804:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2354:x1874703863050496:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 61us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857191.270809:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863050624:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857191.270849:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+5:2354:x1874703863050624:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857191.270856:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 129 00000100:00100000:0.0:1787857191.270871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00100000:0.0:1787857191.270877:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b534b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:2354:x1874703863050240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857191.270914:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b534b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:2354:x1874703863050240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857191.270920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 130 00000100:00080000:0.0:1787857191.270938:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857191.273211:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00010000:00010000:2.0:1787857191.373955:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857192.392315:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857192.778896:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857192.778969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779027:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885077120:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779078:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857192.779083:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885076736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779109:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779128:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885077248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779177:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885076992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779214:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787857192.779219:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885076864:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779266:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885077376:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857192.779334:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076608 00000100:00100000:1.0:1787857192.779341:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076608 00000100:00100000:1.0:1787857192.779408:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787857192.779417:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885076608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857192.779453:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857192.779499:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885076608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779506:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787857192.779528:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077120 00000100:00100000:1.0:1787857192.779532:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077120 00000100:00100000:1.0:1787857192.779558:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077376 00000100:00100000:1.0:1787857192.779561:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077376 00000100:00100000:1.0:1787857192.779580:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787857192.779585:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779616:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885077120:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779622:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787857192.779634:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787857192.779640:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874703885077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779693:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874703885077376:12345-0@lo:400:kworker.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779699:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787857192.779716:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076736 00000100:00100000:1.0:1787857192.779719:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076736 00000100:00100000:1.0:1787857192.779743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787857192.779750:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885076736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779786:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885076736:12345-0@lo:400:kworker.0 Request processed in 37us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787857192.779818:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077248 00000100:00100000:1.0:1787857192.779821:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077248 00000100:00100000:1.0:1787857192.779845:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076992 00000100:00100000:1.0:1787857192.779848:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076992 00000100:00100000:1.0:1787857192.779863:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885076864 00000100:00100000:1.0:1787857192.779866:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885076864 00000100:00100000:1.0:1787857192.779879:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787857192.779884:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885077248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779912:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885077248:12345-0@lo:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787857192.779929:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787857192.779936:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885076992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.779961:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885076992:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.779967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787857192.779977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787857192.779983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885076864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780007:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885076864:12345-0@lo:400:kworker.0 Request processed in 24us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857192.780012:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1787857192.780035:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857192.780038:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857192.780040:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857192.780331:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885076864:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780344:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885077376:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780353:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885076992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780429:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885076736:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780440:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885077248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857192.780455:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857192.780465:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885077120:0@lo:400:kworker.0 00000001:00080000:3.0:1787857192.874283:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787857192.874304:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787857192.888447:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:1.0:1787857192.888471:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787857192.888483:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd97f9ac6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787857192.888489:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97f9ac9c0 00000020:00080000:1.0:1787857192.888492:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97b521000 00000020:00080000:1.0:1787857192.888522:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787857192.888848:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787857192.889066:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787857193.422129:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857193.760389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857193.760489:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863050752 00000100:00100000:1.0:1787857193.760499:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863050752 00000100:00100000:1.0:1787857193.760574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 135 00000100:00100000:1.0:1787857193.760584:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10228:x1874703863050752:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787857193.760726:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10228:x1874703863050752:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857193.760735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 135 00000100:00080000:0.0:1787857193.760813:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857193.769832:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857193.769912:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051008 00000100:00100000:3.0:1787857193.769921:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051008 00000100:00100000:3.0:1787857193.769977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:3.0:1787857193.769987:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:10228:x1874703863051008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787857193.770490:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:10228:x1874703863051008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 502us (666us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787857193.770498:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:2.0:1787857193.800066:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885077504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857193.800140:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857193.800375:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077504 00000100:00100000:1.0:1787857193.800383:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077504 00000100:00100000:1.0:1787857193.800456:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787857193.800465:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885077504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857193.800500:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857193.800561:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885077504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857193.800570:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787857193.800711:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885077504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857194.136778:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857194.136945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051136 00000100:00100000:1.0:1787857194.136954:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051136 00000100:00100000:1.0:1787857194.137038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 136 00000100:00100000:1.0:1787857194.137049:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b535a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+5:11019:x1874703863051136:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:1.0:1787857194.137072:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857194.137092:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf0fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a0f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137157:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137170:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137181:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857194.137790:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857194.137795:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857194.137898:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137926:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf0fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137959:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857194.137968:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:1.0:1787857194.137971:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857194.137975:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978800, rc 0) 00000100:00100000:1.0:1787857194.138045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b535a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:11019:x1874703863051136:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 998us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857194.138053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 136 00000100:00080000:0.0:1787857194.138279:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787857194.439893:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857195.465146:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857196.386382:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857196.386429:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857196.386468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857196.386506:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857196.386531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857196.386830:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051648 00000100:00100000:0.0:1787857196.386835:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051264 00000100:00100000:1.0:1787857196.386841:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051648 00000100:00100000:0.0:1787857196.386848:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051264 00000100:00100000:0.0:1787857196.386901:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 287 00000100:00100000:1.0:1787857196.386905:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051520 00000100:00100000:1.0:1787857196.386911:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051520 00000100:00100000:0.0:1787857196.386913:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863051264:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857196.386937:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:1.0:1787857196.386950:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b536d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863051648:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857196.386990:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863051264:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 80us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857196.386999:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 287 00000100:00100000:1.0:1787857196.387005:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b536d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863051648:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 58us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857196.387013:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:1.0:1787857196.387035:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:1.0:1787857196.387041:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863051520:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857196.387079:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b534000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863051520:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857196.387085:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:1.0:1787857196.387115:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051392 00000100:00100000:1.0:1787857196.387125:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051392 00000100:00080000:3.0:1787857196.387149:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857196.387155:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857196.387155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863051776 00000100:00080000:3.0:1787857196.387159:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857196.387160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863051776 00000100:00080000:3.0:1787857196.387178:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857196.387195:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:1.0:1787857196.387204:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b537c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2353:x1874703863051392:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857196.387210:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 135 00000100:00100000:3.0:1787857196.387223:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b534780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863051776:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857196.396100:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b537c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2353:x1874703863051392:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 8883us (9714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857196.396117:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 134 00000100:00100000:3.0:1787857196.396322:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b534780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863051776:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 9099us (9786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857196.396332:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 135 00010000:00010000:1.0:1787857196.491194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857196.872081:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857196.872090:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857196.872400:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787857196.872410:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857197.513438:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857197.902740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857197.902813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857197.902864:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885078144:0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.902890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857197.902915:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857197.902921:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885077760:0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.902947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857197.902968:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885078272:0@lo:400:kworker.0 00000100:00100000:0.0:1787857197.904906:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885078016:0@lo:400:kworker.0 00000100:00100000:0.0:1787857197.905705:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857197.905748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787857197.905756:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885077888:0@lo:400:kworker.0 00000100:00100000:0.0:1787857197.905783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857197.905804:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885078400:0@lo:400:kworker.0 00000100:00100000:0.0:1787857197.905829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857197.906028:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885078016 00000100:00100000:2.0:1787857197.906037:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885078016 00000100:00100000:2.0:1787857197.906090:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077888 00000100:00100000:2.0:1787857197.906093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077888 00000100:00100000:2.0:1787857197.906113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787857197.906122:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885078016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857197.906183:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885078016:12345-0@lo:400:kworker.0 Request processed in 62us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857197.906190:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787857197.906207:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787857197.906212:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885077888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857197.906239:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885077888:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857197.906244:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787857197.906353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857197.906428:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077632 00000100:00100000:1.0:1787857197.906433:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077632 00000100:00100000:1.0:1787857197.906464:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787857197.906470:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885077632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857197.906499:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857197.906549:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a639a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885077632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (3737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857197.906572:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787857197.906595:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885078144 00000100:00100000:1.0:1787857197.906599:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885078144 00000100:00100000:1.0:1787857197.906622:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885078400 00000100:00100000:1.0:1787857197.906624:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885078400 00000100:00100000:1.0:1787857197.906642:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787857197.906648:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.906700:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885078144:12345-0@lo:400:kworker.0 Request processed in 52us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857197.906707:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787857197.906718:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787857197.906725:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885078400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.906753:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885078400:12345-0@lo:400:kworker.0 Request processed in 29us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857197.906758:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787857197.906778:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885077760 00000100:00100000:1.0:1787857197.906781:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885077760 00000100:00100000:1.0:1787857197.906806:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787857197.906812:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885077760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.906843:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885077760:12345-0@lo:400:kworker.0 Request processed in 31us (3895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857197.906848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787857197.906972:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885078272 00000100:00100000:1.0:1787857197.906977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885078272 00000100:00100000:1.0:1787857197.906995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787857197.907000:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a63a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885078272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.907037:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a63a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885078272:12345-0@lo:400:kworker.0 Request processed in 36us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857197.907043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787857197.907081:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885077760:0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.907094:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885078272:0@lo:400:kworker.0 00000100:00100000:1.0:1787857197.907104:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787857197.907109:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787857197.907132:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857197.907143:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a45e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885078144:0@lo:400:kworker.0 00000100:00080000:2.0:1787857197.909413:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857197.909422:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857197.909425:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857197.909478:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885077888:0@lo:400:kworker.0 00000100:00100000:2.0:1787857197.909494:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885078400:0@lo:400:kworker.0 00000100:00100000:2.0:1787857197.909506:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885078016:0@lo:400:kworker.0 00000020:00080000:3.0:1787857197.980346:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787857197.980372:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787857197.980411:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787857197.980422:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1787857198.257920:0:12246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:59:56 (1787857196) 00010000:00010000:0.0:1787857198.535845:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857198.921897:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857198.921928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885078528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857198.922003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857198.923623:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885078528 00000100:00100000:1.0:1787857198.923636:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885078528 00000100:00100000:1.0:1787857198.923735:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787857198.923746:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885078528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857198.923786:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857198.924042:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885078528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 298us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857198.924051:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787857198.924178:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885078528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857199.560144:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857199.778093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857199.782006:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052032 00000100:00100000:1.0:1787857199.782023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052032 00000100:00100000:1.0:1787857199.782259:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 137 00000100:00100000:1.0:1787857199.782274:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b534f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:11284:x1874703863052032:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857199.782297:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857199.782331:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbf10a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a16 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782407:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782421:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782433:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782448:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782455:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782462:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782986:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf11f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.782997:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf11f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.783004:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf11f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857199.783015:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787857199.791312:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791355:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791362:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791369:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857199.791373:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791380:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791399:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd946159700) 00010000:00010000:1.0:1787857199.791402:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857199.791407:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791413:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf111 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791431:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791437:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791444:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791449:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857199.791458:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791465:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791473:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857199.791476:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857199.791479:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.791485:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf118 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.792040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbf10a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a16 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.792058:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf11f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a16 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.792065:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:1.0:1787857199.792068:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857199.792070:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978600, rc 0) 00000100:00080000:2.0:1787857199.794086:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857199.794198:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b534f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:11284:x1874703863052032:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 11922us (16110us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787857199.794211:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 137 00000100:00100000:2.0:1787857199.803928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857199.803974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857199.804045:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052160 00000100:00100000:1.0:1787857199.804054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052160 00000100:00100000:1.0:1787857199.804127:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:1.0:1787857199.804138:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:2353:x1874703863052160:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857199.804155:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857199.804179:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf11f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a16 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857199.804212:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:1.0:1787857199.804217:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857199.804290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2353:x1874703863052160:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857199.804297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1787857199.804929:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052288 00000100:00100000:3.0:1787857199.804936:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052288 00000100:00100000:3.0:1787857199.804982:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 138 00000100:00100000:3.0:1787857199.804990:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11284:x1874703863052288:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787857199.805080:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11284:x1874703863052288:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 90us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857199.805086:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 138 00000040:00080000:1.0:1787857199.948589:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787857199.948599:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787857199.948635:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787857199.948641:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787857200.587686:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857201.510302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.510356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.510379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.510420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857201.510455:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052928 00000100:00100000:3.0:1787857201.510466:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052928 00000100:00100000:2.0:1787857201.510467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.510488:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052544 00000100:00100000:2.0:1787857201.510492:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052544 00000100:00100000:3.0:1787857201.510535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:2.0:1787857201.510541:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 140 00000100:00100000:2.0:1787857201.510548:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2355:x1874703863052544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857201.510629:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:2355:x1874703863052544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.510636:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 140 00000100:00100000:1.0:1787857201.510949:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052416 00000100:00100000:1.0:1787857201.510953:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052416 00000100:00100000:1.0:1787857201.510988:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 289 00000100:00100000:1.0:1787857201.510995:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863052416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857201.511020:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863052416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857201.511026:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 289 00000100:00100000:1.0:1787857201.511054:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052672 00000100:00100000:1.0:1787857201.511058:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052672 00000100:00100000:1.0:1787857201.511083:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863052800 00000100:00100000:1.0:1787857201.511086:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863052800 00000100:00100000:1.0:1787857201.511103:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1787857201.511108:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863052672:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857201.511131:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863052672:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 23us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857201.511147:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1787857201.511158:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:1.0:1787857201.511163:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703863052800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857201.511183:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2355:x1874703863052800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 20us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857201.511188:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00080000:2.0:1787857201.511767:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857201.511772:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787857201.511775:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857201.513985:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2355:x1874703863052928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857201.516585:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2355:x1874703863052928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 2614us (6189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857201.516604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:2.0:1787857201.535565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857201.535645:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053056 00000100:00100000:3.0:1787857201.535655:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053056 00000100:00100000:3.0:1787857201.535730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:3.0:1787857201.535740:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11326:x1874703863053056:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857201.535761:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857201.535781:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf12d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535845:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535859:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535873:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535888:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535895:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.535913:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536386:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536394:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536401:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536408:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857201.536413:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536421:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536434:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:3.0:1787857201.536437:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857201.536441:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536448:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536460:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536466:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536478:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536483:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857201.536486:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536493:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536503:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fd946159500) 00010000:00010000:3.0:1787857201.536505:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857201.536508:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536513:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf13b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536546:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf12d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a1d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536556:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:3.0:1787857201.536558:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857201.536561:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf12d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a1d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.536570:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857201.536686:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11326:x1874703863053056:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 947us (1132us total) trans 0 rc 301/301 00000100:00100000:3.0:1787857201.536703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 139 00000100:00100000:0.0:1787857201.554428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857201.555475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053312 00000100:00100000:3.0:1787857201.555486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053312 00000100:00100000:3.0:1787857201.555553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 140 00000100:00100000:3.0:1787857201.555564:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11326:x1874703863053312:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1787857201.555625:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857201.555651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbeaab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882856 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.555684:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:3.0:1787857201.555690:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857201.555952:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.555967:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.555975:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.556006:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.556020:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 5 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857201.556034:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b536580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885078656:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857201.556206:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96d9993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857201.560173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.560261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053440 00000100:00100000:2.0:1787857201.560271:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053440 00010000:00010000:2.0:1787857201.560316:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 6 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857201.560434:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1787857201.560445:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2352:x1874703863053440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857201.560461:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857201.560468:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 6 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.560483:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 6 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.561450:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:2.0:1787857201.561468:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.561478:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.561486:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.561516:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857201.561781:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2352:x1874703863053440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1336us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.561790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00010000:00010000:0.0:1787857201.563752:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a0f expref: 5 pid: 5837 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.563773:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b536580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1874703885078656:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857201.563797:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.563916:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.563931:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.563953:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.563965:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.563974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857201.570010:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787857201.570033:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571295:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571310:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571318:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857201.571323:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571333:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571351:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953423d00) 00010000:00010000:0.0:1787857201.571354:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857201.571369:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.571376:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf142 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857201.571407:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000815c0bc9 reply state 00000000bae5b7c6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.571417:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857201.571534:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:11326:x1874703863053312:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 15967us (17114us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787857201.571543:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 140 00010000:00010000:0.0:1787857201.575288:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575307:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575316:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575323:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857201.575328:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575336:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575354:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fd953447400) 00010000:00010000:0.0:1787857201.575357:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857201.575363:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.575377:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf149 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.608066:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857201.669473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857201.669601:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053568 00000100:00100000:3.0:1787857201.669612:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053568 00000100:00100000:3.0:1787857201.669708:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 141 00000100:00100000:3.0:1787857201.669718:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+15:11334:x1874703863053568:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:3.0:1787857201.669745:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857201.669769:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a24 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.669833:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.669847:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.669859:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857201.669924:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787857201.669928:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857201.669955:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.669979:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a24 expref: 17 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.669997:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a24 expref: 16 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857201.670024:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:3.0:1787857201.670027:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857201.670030:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216cc00, rc 0) 00000100:00100000:3.0:1787857201.670093:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:11334:x1874703863053568:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 376us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857201.670100:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 141 00000100:00100000:3.0:1787857201.715137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.715427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053696 00000100:00100000:2.0:1787857201.715437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053696 00000100:00100000:2.0:1787857201.715501:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 142 00000100:00100000:2.0:1787857201.715512:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+16:11340:x1874703863053696:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857201.715530:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857201.715552:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a2b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715618:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715632:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715644:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715728:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715737:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715743:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715857:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715865:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.715873:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857201.715904:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787857201.715907:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857201.716866:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.716886:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.716893:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.716900:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.718889:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857201.718906:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.718918:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719045:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:2.0:1787857201.719048:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857201.719054:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719060:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719081:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719087:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719093:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719098:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857201.719100:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719107:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719134:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fd949362400) 00010000:00010000:2.0:1787857201.719137:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857201.719140:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719146:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf16c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719271:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a2b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719461:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a2b expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.719470:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857201.719472:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857201.719475:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85000, rc 0) 00000100:00100000:2.0:1787857201.719551:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:11340:x1874703863053696:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4040us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.719562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 142 00000100:00100000:2.0:1787857201.728185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.728567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863053952 00000100:00100000:0.0:1787857201.728577:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863053952 00000100:00100000:0.0:1787857201.728635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 143 00000100:00100000:0.0:1787857201.728646:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:11340:x1874703863053952:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857201.728704:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857201.728724:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf17a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a32 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729051:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729067:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729078:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729094:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729101:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.729108:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857201.731523:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787857201.732244:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732261:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732282:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732321:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732328:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732335:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732340:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857201.732344:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732352:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732365:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:1.0:1787857201.732368:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857201.732373:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732380:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf181 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857201.732396:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a6682db reply state 00000000163cab65 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857201.732406:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787857201.732450:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf17a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732467:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.732473:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857201.732476:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857201.732478:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978000, rc 0) 00000100:00100000:1.0:1787857201.732888:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11340:x1874703863053952:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4241us (4713us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787857201.732898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 143 00000100:00100000:3.0:1787857201.743742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.743813:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863054080 00000100:00100000:0.0:1787857201.743822:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863054080 00000100:00100000:0.0:1787857201.743881:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:0.0:1787857201.743892:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b536580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863054080:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857201.743912:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857201.743932:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a39 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787857201.743962:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857201.743981:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1787857201.743986:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857201.743994:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.744034:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.744047:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857201.744106:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b536580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863054080:12345-192.168.204.29@tcp:101:bash.0 Request processed in 216us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857201.744113:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00010000:00010000:1.0:1787857201.744430:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744439:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744447:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744453:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857201.744458:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744466:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744481:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd963a5fd00) 00010000:00010000:1.0:1787857201.744484:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857201.744496:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.744503:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.747352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857201.747428:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863054208 00000100:00100000:1.0:1787857201.747437:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863054208 00000100:00100000:1.0:1787857201.747505:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:1.0:1787857201.747515:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:11340:x1874703863054208:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857201.747532:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857201.747549:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a40 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.747590:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.747601:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857201.747605:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857201.747611:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 7 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.747645:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.747691:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857201.747727:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885078784:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857201.747815:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857201.754000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857201.754106:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a638000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885078784:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857201.754142:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 7 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.754163:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978a00, rc 0) 00000100:00100000:1.0:1787857201.754234:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:11340:x1874703863054208:12345-192.168.204.29@tcp:101:bash.0 Request processed in 6720us (6891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857201.754243:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:2.0:1787857201.754594:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863054336 00000100:00100000:2.0:1787857201.754602:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863054336 00010000:00010000:2.0:1787857201.754636:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857201.754708:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:2.0:1787857201.754732:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863054336:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857201.754747:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857201.754773:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.754786:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.754814:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf19d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a39 expref: 7 pid: 6676 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.754828:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857201.754833:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857201.754841:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.754852:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.754887:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857201.754900:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dccf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885078912:192.168.204.29@tcp:105: 00000100:00100000:2.0:1787857201.754957:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9613df480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857201.758289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.758381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863054592 00000100:00100000:0.0:1787857201.758391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863054592 00000100:00100000:0.0:1787857201.758450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:0.0:1787857201.758461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11340:x1874703863054592:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:0.0:1787857201.758890:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11340:x1874703863054592:12345-192.168.204.29@tcp:35:bash.0 Request processed in 430us (610us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787857201.758898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1787857201.761233:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dccf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5821:1874703885078912:192.168.204.29@tcp:105: 00010000:00010000:2.0:1787857201.761281:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857201.761337:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863054336:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 6606us (7346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.761348:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1787857201.849426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.849577:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863054848 00000100:00100000:0.0:1787857201.849590:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863054848 00000100:00100000:0.0:1787857201.849688:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00100000:0.0:1787857201.849699:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11350:x1874703863054848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857201.849725:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857201.849754:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf1ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a47 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857201.849858:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787857201.850005:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf1ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a47 expref: 22 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.850020:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:0.0:1787857201.850023:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857201.850029:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf1ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a47 expref: 22 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.850043:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560c00, rc 0) 00000100:00100000:0.0:1787857201.850112:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11350:x1874703863054848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 415us (695us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787857201.850119:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00100000:3.0:1787857201.855749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.856326:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863055104 00000100:00100000:0.0:1787857201.856337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863055104 00000100:00100000:0.0:1787857201.856400:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1787857201.856411:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11350:x1874703863055104:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857201.856717:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:11350:x1874703863055104:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 307us (1217us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787857201.856726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:1.0:1787857201.946689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.946827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863055232 00000100:00100000:2.0:1787857201.946837:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863055232 00000100:00100000:2.0:1787857201.946911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 145 00000100:00100000:2.0:1787857201.946922:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:11356:x1874703863055232:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857201.946944:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857201.946963:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a4e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947022:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947036:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947047:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857201.947102:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787857201.947106:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857201.947126:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947161:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a4e expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947179:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a4e expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.947211:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857201.947214:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857201.947218:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84000, rc 0) 00000100:00100000:2.0:1787857201.947271:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a638000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11356:x1874703863055232:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 351us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.947277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 145 00000100:00100000:3.0:1787857201.949911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857201.949973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863055488 00000100:00100000:1.0:1787857201.949983:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863055488 00000100:00100000:1.0:1787857201.950036:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 146 00000100:00100000:1.0:1787857201.950044:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11356:x1874703863055488:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857201.950063:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857201.950081:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf1c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a55 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.950173:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.950200:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.950229:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857201.950241:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787857201.950400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979600/0xf326646fe3bbf1c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a55 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.950420:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a55 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.950429:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857201.950432:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857201.950436:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978600, rc 0) 00000100:00100000:1.0:1787857201.950516:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11356:x1874703863055488:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 466us (605us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787857201.950524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 146 00000100:00100000:3.0:1787857201.955895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.956742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.957030:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863055872 00000100:00100000:0.0:1787857201.957039:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863055872 00000100:00100000:0.0:1787857201.957099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:0.0:1787857201.957109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11356:x1874703863055872:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857201.957131:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857201.957151:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf1dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a5c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.957284:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.957299:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.957311:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857201.957323:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787857201.957904:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf1dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a5c expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.957925:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a5c expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.957934:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:0.0:1787857201.957938:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787857201.957941:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857201.958000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11356:x1874703863055872:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 893us (1267us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787857201.958009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 147 00000100:00100000:1.0:1787857201.958601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863055744 00000100:00100000:1.0:1787857201.958610:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863055744 00000100:00100000:1.0:1787857201.958674:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1787857201.958684:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:2355:x1874703863055744:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857201.958698:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857201.958721:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a55 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.958737:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857201.958741:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857201.958778:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:2355:x1874703863055744:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 96us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857201.958787:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1787857201.965341:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.965920:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056000 00000100:00100000:0.0:1787857201.965931:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056000 00000100:00100000:0.0:1787857201.965983:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857201.965993:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863056000:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:0.0:1787857201.966044:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.966080:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.966089:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857201.966094:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857201.966098:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.966134:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.966148:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 6 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.966163:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874703885079040:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857201.966303:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857201.972764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.972963:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056128 00000100:00100000:2.0:1787857201.972973:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056128 00002000:00100000:2.0:1787857201.973023:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fd9602b21c0 x1874703863056128/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:602/0 lens 504/0 e 0 to 0 dl 1787857212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857201.973035:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd9602b21c0 with x1874703863056128 ext(0->12) 00010000:00010000:2.0:1787857201.973054:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 7 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.973072:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 7 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857201.973081:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd9602b21c0 00000100:00100000:2.0:1787857201.973109:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1787857201.973118:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863056128:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:2.0:1787857201.974252:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863056128:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 1128us (1491us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787857201.974263:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00002000:00100000:2.0:1787857201.974280:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fd9602b21c0 x1874703863056128/t4294967305(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:602/0 lens 504/448 e 0 to 0 dl 1787857212 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857201.974289:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd9602b21c0 with x1874703863056128 ext(0->12) 00010000:00010000:2.0:1787857201.974297:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.974313:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857201.974321:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd9602b21c0 00000100:00100000:1.0:1787857201.974989:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874703885079040:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857201.975021:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857201.978969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857201.979143:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056256 00000100:00100000:2.0:1787857201.979153:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056256 00010000:00010000:2.0:1787857201.979205:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857201.979247:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1787857201.979258:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863056256:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857201.979273:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787857201.979291:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787857201.979294:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787857201 00002000:00010000:2.0:1787857201.979297:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787857201 00002000:00010000:2.0:1787857201.979299:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787857201 00010000:00010000:2.0:1787857201.979306:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.979321:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.979361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d14ac45/0xf326646fe3bbf1a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a40 expref: 9 pid: 8078 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.979377:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857201.979393:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857201.979400:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.979412:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857201.979448:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857201.979515:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863056256:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 258us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857201.979523:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00010000:00010000:0.0:1787857201.979596:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979607:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979647:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979688:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979697:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979704:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857201.979708:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979717:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979728:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.979744:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684508f6/0xf326646fe3bbf1f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.979788:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863056000:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 13797us (14458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857201.979796:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1787857201.985040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857201.985136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056512 00000100:00100000:1.0:1787857201.985146:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056512 00000100:00100000:1.0:1787857201.985212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:1.0:1787857201.985222:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d467050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:11356:x1874703863056512:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:1.0:1787857201.985288:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a5c expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857201.985571:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787857201.985622:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787857201.986980:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787857201.987056:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.987075:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.987085:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.987122:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.987147:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 30 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857201.987164:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874703885079168:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857201.987260:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857201.991262:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5839:1874703885079168:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857201.991294:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857201.992305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857201.993369:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056640 00000100:00100000:0.0:1787857201.993456:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056640 00010000:00010000:0.0:1787857201.994194:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 31 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857201.994320:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:0.0:1787857201.994333:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:2353:x1874703863056640:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857201.994361:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857201.994369:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 31 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994382:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 31 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994416:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978000/0xf326646fe3bbf18f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a32 expref: 31 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994433:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:0.0:1787857201.994439:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994448:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994456:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857201.994488:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857201.994562:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:2353:x1874703863056640:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 233us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857201.994570:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00010000:00010000:1.0:1787857201.994629:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857201.995850:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857201.995995:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787857201.996238:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787857201.996352:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885079296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857201.996429:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857201.996473:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9452f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857201.996691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885079296 00000100:00100000:3.0:1787857201.996699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885079296 00000100:00100000:3.0:1787857201.996769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787857201.996778:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874703885079296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857201.996853:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874703885079296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857201.996860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787857201.998211:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857201.998259:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885079296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857201.998975:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787857201.999053:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885079424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787857201.999105:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857201.999133:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857201.999388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885079424 00000100:00100000:3.0:1787857201.999400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885079424 00000100:00100000:3.0:1787857201.999447:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787857201.999455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1874703885079424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787857201.999997:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1874703885079424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 542us (890us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787857202.000005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787857202.000116:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975a470c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5839:1874703885079424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787857202.000172:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787857202.000229:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000239:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000247:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000254:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857202.000259:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000267:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000283:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857202.000286:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857202.000291:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.000298:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf1f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857202.001818:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857202.002219:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787857202.002233:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356330571698ns, next at 357330568457ns, rc = 0 00000001:00080000:1.0:1787857202.002241:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787857202.002292:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857202.002309:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857202.002321:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf1e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a5c expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857202.003122:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d467050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11356:x1874703863056512:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 17898us (18089us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787857202.003133:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000020:00080000:1.0:1787857202.003138:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787857202.008076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.008207:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863056768 00000100:00100000:2.0:1787857202.008216:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863056768 00000100:00100000:2.0:1787857202.008303:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:2.0:1787857202.008314:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11356:x1874703863056768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857202.008341:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857202.008363:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a63 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.008434:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a63 expref: 34 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.008460:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a63 expref: 34 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.008482:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.008485:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857202.008499:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84600, rc 0) 00000100:00100000:2.0:1787857202.008611:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11356:x1874703863056768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 298us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857202.008618:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:3.0:1787857202.017100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.018002:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863057024 00000100:00100000:2.0:1787857202.018014:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863057024 00000100:00100000:2.0:1787857202.018077:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:2.0:1787857202.018087:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11356:x1874703863057024:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857202.019364:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11356:x1874703863057024:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1271us (2268us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787857202.019375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:3.0:1787857202.119564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.119767:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863057280 00000100:00100000:0.0:1787857202.119776:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863057280 00000100:00100000:0.0:1787857202.119843:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00100000:0.0:1787857202.119851:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11366:x1874703863057280:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857202.119878:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857202.119900:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a6a expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857202.120021:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787857202.120143:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf206 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a6a expref: 37 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.120158:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:0.0:1787857202.120161:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857202.120166:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a6a expref: 37 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.120193:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857202.120272:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11366:x1874703863057280:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 419us (724us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787857202.120281:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00100000:1.0:1787857202.127801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.127939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863057408 00000100:00100000:2.0:1787857202.127949:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863057408 00000100:00100000:2.0:1787857202.128007:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 150 00000100:00100000:2.0:1787857202.128017:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11366:x1874703863057408:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:2.0:1787857202.128212:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128230:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128265:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128280:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128287:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128380:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128474:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128483:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128826:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857202.128868:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128880:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128887:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128894:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128911:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857202.128915:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128922:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128935:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857202.128938:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857202.128943:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128949:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128964:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128970:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128977:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128982:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857202.128984:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.128991:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129007:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362800) 00010000:00010000:2.0:1787857202.129010:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857202.129013:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129019:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129031:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129037:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129167:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129174:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857202.129177:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129193:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129203:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.129205:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857202.129208:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.129214:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857202.129347:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9769d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11366:x1874703863057408:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 1329us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857202.129355:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 150 00000100:00100000:3.0:1787857202.131947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.132019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863057664 00000100:00100000:0.0:1787857202.132030:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863057664 00000100:00100000:0.0:1787857202.132094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:0.0:1787857202.132104:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11366:x1874703863057664:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857202.132543:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:11366:x1874703863057664:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 439us (606us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787857202.132573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:3.0:1787857202.170004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.170210:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863057920 00000100:00100000:2.0:1787857202.170219:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863057920 00000100:00100000:2.0:1787857202.170276:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 151 00000100:00100000:2.0:1787857202.170286:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:11369:x1874703863057920:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857202.170310:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857202.170329:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a71 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170399:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170413:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170424:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170436:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170442:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170448:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170607:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170616:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170623:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857202.170633:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787857202.170769:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170777:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170784:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170790:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857202.170794:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170801:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170812:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857202.170815:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857202.170819:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170834:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbf230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170846:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170851:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170856:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170861:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857202.170863:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170868:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170874:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362800) 00010000:00010000:2.0:1787857202.170876:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857202.170878:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170883:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170921:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 40 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170934:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 39 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.170947:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.170956:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857202.170959:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85a00, rc 0) 00000100:00100000:2.0:1787857202.171025:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11369:x1874703863057920:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 741us (1031us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787857202.171032:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 151 00000100:00100000:1.0:1787857202.185247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857202.185483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863058048 00000100:00100000:3.0:1787857202.185504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863058048 00000100:00100000:3.0:1787857202.185705:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:3.0:1787857202.185717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11369:x1874703863058048:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1787857202.186014:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186034:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186047:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186074:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186082:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186088:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186108:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857202.186113:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186121:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186133:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857202.186137:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857202.186621:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.186630:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf24c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857202.187036:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd947e792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11369:x1874703863058048:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 1319us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857202.187059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 152 00000100:00100000:1.0:1787857202.200383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.200509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863058304 00000100:00100000:2.0:1787857202.200518:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863058304 00000100:00100000:2.0:1787857202.200587:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:2.0:1787857202.200597:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11369:x1874703863058304:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857202.201222:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:11369:x1874703863058304:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 490us (715us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787857202.201231:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:1.0:1787857202.518620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.518829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863058560 00000100:00100000:2.0:1787857202.518840:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863058560 00000100:00100000:2.0:1787857202.518899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:2.0:1787857202.518908:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:11400:x1874703863058560:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1787857202.518933:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857202.518954:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a78 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.519055:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf25a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.519070:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.519097:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf25a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857202.519110:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787857202.519244:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85e00/0xf326646fe3bbf253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a78 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.519264:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf25a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a78 expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.519273:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.519276:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857202.519279:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85600, rc 0) 00000100:00100000:2.0:1787857202.519336:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11400:x1874703863058560:12345-192.168.204.29@tcp:101:cat.0 Request processed in 429us (726us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787857202.519344:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:1.0:1787857202.530092:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857202.530253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.530350:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863058816 00000100:00100000:0.0:1787857202.530361:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863058816 00000100:00100000:0.0:1787857202.530469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1787857202.530497:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11400:x1874703863058816:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:0.0:1787857202.530990:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:11400:x1874703863058816:12345-192.168.204.29@tcp:35:cat.0 Request processed in 496us (923us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787857202.530999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1787857202.531196:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863058944 00000100:00100000:3.0:1787857202.531202:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863058944 00000100:00100000:3.0:1787857202.531247:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857202.531256:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:2355:x1874703863058944:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857202.531267:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857202.531295:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf25a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a78 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.531313:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857202.531318:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857202.531355:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:2355:x1874703863058944:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 101us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857202.531363:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:1.0:1787857202.595010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.595115:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863059200 00000100:00100000:0.0:1787857202.595125:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863059200 00000100:00100000:0.0:1787857202.595198:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:0.0:1787857202.595208:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11406:x1874703863059200:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:0.0:1787857202.595231:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857202.595235:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787857202.595263:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf1c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a4e expref: 42 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595287:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857202.595292:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857202.595306:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf268 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a7f expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595406:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595420:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 42 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595444:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595491:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 42 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.595506:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 42 pid: 8856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857202.595936:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885079552:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857202.596320:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857202.608448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.609113:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885079552:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857202.609145:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857202.609221:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863059328 00000100:00100000:2.0:1787857202.609230:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863059328 00010000:00010000:2.0:1787857202.609266:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 43 pid: 8856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857202.609343:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1787857202.609353:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:2352:x1874703863059328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857202.609367:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857202.609375:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 43 pid: 8856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609406:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 43 pid: 8856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609430:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a71 expref: 43 pid: 8856 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609451:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.609456:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609467:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609475:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.609827:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857202.609887:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:2352:x1874703863059328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 535us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857202.609896:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00010000:00010000:1.0:1787857202.609955:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.609963:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857202.609982:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787857202.610146:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf268 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 43 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.610163:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 42 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.610195:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:1.0:1787857202.610198:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787857202.610201:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560c00, rc 0) 00000100:00100000:1.0:1787857202.610228:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd952a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11406:x1874703863059200:12345-192.168.204.29@tcp:101:dd.0 Request processed in 15022us (15228us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787857202.610235:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:1.0:1787857202.613019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857202.613127:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863059584 00000100:00100000:3.0:1787857202.613139:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863059584 00000100:00100000:3.0:1787857202.613213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 155 00000100:00100000:3.0:1787857202.613224:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11406:x1874703863059584:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:3.0:1787857202.613517:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.613536:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.613553:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857202.613602:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787857202.613623:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e19b370 reply state 00000000e4dcd4ee transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857202.613632:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857202.613746:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975484f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:11406:x1874703863059584:12345-192.168.204.29@tcp:36:dd.0 Request processed in 523us (742us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787857202.613753:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 155 00000020:00080000:3.0:1787857202.613758:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787857202.615312:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615328:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615357:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615365:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857202.615370:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615378:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615394:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857202.615397:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857202.615403:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.615410:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf27d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.631935:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857202.839058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857202.839850:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863059712 00000100:00100000:0.0:1787857202.839861:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863059712 00000100:00100000:0.0:1787857202.839928:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 156 00000100:00100000:0.0:1787857202.839937:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+44:11420:x1874703863059712:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:0.0:1787857202.839960:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857202.839979:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a86 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840043:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840075:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840088:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840103:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840110:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840116:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840226:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840236:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 45 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840246:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840277:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 45 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.840290:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 45 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857202.840313:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885079680:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857202.840851:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857202.843901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.844150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863059968 00000100:00100000:2.0:1787857202.844159:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863059968 00000100:00100000:2.0:1787857202.844228:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:2.0:1787857202.844238:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:5591:x1874703863059968:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787857202.844837:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:5591:x1874703863059968:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 598us (942us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787857202.844846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:0.0:1787857202.845099:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b2580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885079680:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857202.845128:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857202.847767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857202.847852:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863060096 00000100:00100000:2.0:1787857202.847861:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863060096 00010000:00010000:2.0:1787857202.847899:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 47 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857202.847969:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1787857202.847979:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:2353:x1874703863060096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857202.847994:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857202.848001:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 47 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848013:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 47 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848034:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf26f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a7f expref: 47 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848050:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857202.848054:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848063:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848070:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857202.848143:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857202.848206:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:2353:x1874703863060096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 228us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857202.848224:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00010000:00010000:0.0:1787857202.848897:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.848907:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857202.848953:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787857202.848958:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857202.848979:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.848992:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849002:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849009:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849016:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849022:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857202.849037:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849046:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849058:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857202.849061:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857202.849065:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849071:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf28b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849085:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849091:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849097:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849102:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857202.849104:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849110:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849117:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447400) 00010000:00010000:0.0:1787857202.849119:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857202.849128:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849134:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849886:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a86 expref: 46 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849907:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a86 expref: 45 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857202.849915:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:0.0:1787857202.849918:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857202.849921:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857202.849985:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975485680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:11420:x1874703863059712:12345-192.168.204.29@tcp:101:stat.0 Request processed in 10048us (10936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857202.849994:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 156 00000100:00100000:3.0:1787857202.893833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857202.893903:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863060352 00000100:00100000:1.0:1787857202.893913:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863060352 00000100:00100000:1.0:1787857202.893975:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 157 00000100:00100000:1.0:1787857202.893986:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+45:11426:x1874703863060352:12345-192.168.204.29@tcp:36:truncate.0 00010000:00010000:1.0:1787857202.894048:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857202.894078:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a86 expref: 45 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.894099:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:1.0:1787857202.894104:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857202.894332:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.894347:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.894357:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857202.894428:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787857202.894454:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007615a46 reply state 00000000b6f694c4 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857202.894463:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787857202.895198:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:11426:x1874703863060352:12345-192.168.204.29@tcp:36:truncate.0 Request processed in 1210us (1371us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787857202.895205:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 157 00000020:00080000:1.0:1787857202.895211:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787857202.896918:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.896932:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.896940:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.896947:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857202.896951:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.896972:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.896986:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857202.896989:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857202.896995:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857202.897001:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf2a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857202.996897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857202.997645:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863060480 00000100:00100000:1.0:1787857202.997656:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863060480 00000100:00100000:1.0:1787857202.997751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:1.0:1787857202.997761:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+46:11440:x1874703863060480:12345-192.168.204.29@tcp:101:stat.0 00010000:00010000:1.0:1787857202.997788:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857202.997813:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf2a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997889:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997904:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997917:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997945:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997968:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.997974:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.998395:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.998405:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.998413:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857202.998452:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787857202.998457:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857202.999376:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999392:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999403:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999410:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999417:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999437:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857202.999441:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999449:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999462:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:1.0:1787857202.999465:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857202.999808:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999839:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999845:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999852:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999857:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857202.999860:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999866:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999885:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd963a5f300) 00010000:00010000:1.0:1787857202.999887:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857202.999890:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999896:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999937:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978800/0xf326646fe3bbf2a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999952:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857202.999960:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:1.0:1787857202.999962:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857202.999964:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978200, rc 0) 00000100:00100000:1.0:1787857203.000061:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+47:11440:x1874703863060480:12345-192.168.204.29@tcp:101:stat.0 Request processed in 2295us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857203.000070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:0.0:1787857203.016122:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857203.016149:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885079808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857203.016925:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857203.017077:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885079936:0@lo:400:kworker.0 00000100:00100000:0.0:1787857203.017112:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857203.017135:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885080448:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.017286:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885079808 00000100:00100000:3.0:1787857203.017296:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885079808 00000100:00100000:3.0:1787857203.017361:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787857203.017372:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885079808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857203.017412:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857203.017460:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885079808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.017468:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787857203.017494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885080064:0@lo:400:kworker.0 00000100:00080000:3.0:1787857203.017529:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857203.017690:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885080320:0@lo:400:kworker.0 00000100:00100000:1.0:1787857203.017724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857203.017782:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885079936 00000100:00100000:1.0:1787857203.017786:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885079936 00000100:00100000:1.0:1787857203.017815:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787857203.017822:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885079936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857203.017857:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885079936:12345-0@lo:400:kworker.0 Request processed in 36us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857203.017880:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787857203.017968:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857203.018013:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885079808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857203.018036:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885079936:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018215:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885080320 00000100:00100000:3.0:1787857203.018220:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885080320 00000100:00100000:3.0:1787857203.018262:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787857203.018269:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885080320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018309:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874703885080320:12345-0@lo:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.018336:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787857203.018356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857203.018380:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857203.018387:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885080192:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857203.018444:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885080320:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018461:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885080448 00000100:00100000:3.0:1787857203.018464:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885080448 00000100:00100000:3.0:1787857203.018503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885080064 00000100:00100000:3.0:1787857203.018506:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885080064 00000100:00100000:3.0:1787857203.018522:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885080192 00000100:00100000:3.0:1787857203.018524:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885080192 00000100:00100000:3.0:1787857203.018537:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787857203.018543:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885080448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018578:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96ddd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885080448:12345-0@lo:400:kworker.0 Request processed in 35us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.018584:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787857203.018596:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787857203.018602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885080064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018632:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885080064:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.018638:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787857203.018650:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787857203.018655:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885080192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018711:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885080192:12345-0@lo:400:kworker.0 Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.018726:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787857203.018753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885080192:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018762:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885080064:0@lo:400:kworker.0 00000100:00100000:3.0:1787857203.018784:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885080448:0@lo:400:kworker.0 00000100:00080000:0.0:1787857203.022690:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787857203.022701:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857203.068293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000001:00080000:2.0:1787857203.076045:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000001:00080000:2.0:1787857203.076076:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:2.0:1787857203.076085:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787857203.076104:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd945f0b000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787857203.076109:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd97f9f9700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd945f0b0c0 00000020:00080000:2.0:1787857203.076112:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd97f9f9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97b521000 00000020:00080000:0.0:1787857203.077387:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1787857203.077604:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863060736 00000100:00100000:3.0:1787857203.077618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863060736 00000100:00100000:3.0:1787857203.077715:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00100000:3.0:1787857203.077726:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+17:11450:x1874703863060736:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857203.077748:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857203.077770:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a94 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857203.078021:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00100000:2.0:1787857203.078371:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857203.078389:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885080576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787857203.078462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787857203.078694:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:0.0:1787857203.078705:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857203.079347:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885080576 00000100:00100000:2.0:1787857203.079357:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885080576 00000100:00100000:2.0:1787857203.079403:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787857203.079412:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874703885080576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857203.079437:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787857203.079788:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a908931, atime: 0x6a908931, ctime: 0x6a908931, blocks: 0xb 00010000:00010000:2.0:1787857203.079799:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.079817:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1787857203.079822:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857203.079829:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.079847:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.079874:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.079882:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.079900:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787857203.080510:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874703885080576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1095us (2043us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787857203.080519:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787857203.080549:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857203.080556:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.080565:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857203.080570:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.080580:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.080598:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.080606:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf2d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.080635:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857203.080637:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857203.080640:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857203.080732:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd842dce940/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787857203.080740:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885080576:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787857203.083279:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a94 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.083309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:3.0:1787857203.083313:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857203.083319:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a94 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.083338:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216dc00, rc 0) 00000100:00100000:3.0:1787857203.083432:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b555a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+18:11450:x1874703863060736:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5706us (15149us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787857203.083442:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00100000:2.0:1787857203.088423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.088561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863060992 00000100:00100000:3.0:1787857203.088571:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863060992 00000100:00100000:3.0:1787857203.088632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1787857203.088643:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d466450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+18:11450:x1874703863060992:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1787857203.089137:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d466450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11450:x1874703863060992:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 493us (720us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787857203.089145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000001:00080000:3.0:1787857203.100925:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1787857203.100959:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787857203.146924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857203.147050:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863061248 00000100:00100000:1.0:1787857203.147060:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863061248 00000100:00100000:1.0:1787857203.147132:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 160 00000100:00100000:1.0:1787857203.147143:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11456:x1874703863061248:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857203.147176:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857203.147198:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882a9b expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.147311:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.147328:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.147338:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.147378:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.147392:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 20 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857203.147406:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b557c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885080704:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857203.147513:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948be0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857203.150730:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b557c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885080704:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857203.150759:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857203.151034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.151121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863061376 00000100:00100000:2.0:1787857203.151128:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863061376 00010000:00010000:2.0:1787857203.151236:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857203.151325:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:2.0:1787857203.151337:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:2353:x1874703863061376:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857203.151354:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857203.151362:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151376:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151403:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978200/0xf326646fe3bbf2bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a8d expref: 21 pid: 5836 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151421:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857203.151426:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151451:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151459:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.151489:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857203.151639:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.151649:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857203.151707:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:2.0:1787857203.151719:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2353:x1874703863061376:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 383us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857203.151728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00010000:00010000:3.0:1787857203.151872:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf2d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 21 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.151888:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 20 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.151906:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857203.151909:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787857203.151912:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979200, rc 0) 00000100:00100000:3.0:1787857203.151939:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11456:x1874703863061248:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4799us (5026us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787857203.151948:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 160 00000100:00100000:1.0:1787857203.154420:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.160894:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863061632 00000100:00100000:2.0:1787857203.160910:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863061632 00000100:00100000:3.0:1787857203.162229:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 161 00000100:00100000:3.0:1787857203.162250:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11456:x1874703863061632:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:3.0:1787857203.163490:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.163520:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.163532:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857203.163586:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787857203.163612:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099776ad4 reply state 000000002d6214cb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857203.163621:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857203.163746:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b556d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11456:x1874703863061632:12345-192.168.204.29@tcp:36:bash.0 Request processed in 1502us (9333us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787857203.163756:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 161 00000020:00080000:3.0:1787857203.163762:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787857203.171001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.171279:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863061760 00000100:00100000:2.0:1787857203.171290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863061760 00000100:00100000:2.0:1787857203.171351:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00100000:2.0:1787857203.171362:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11456:x1874703863061760:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857203.171387:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857203.171408:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf2f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882aa2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171703:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171720:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171729:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171752:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171768:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171790:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.171804:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857203.171817:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885080832:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857203.171899:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94e145cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787857203.175798:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175831:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175841:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175848:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857203.175853:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175861:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175878:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857203.175881:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857203.175886:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175897:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.175904:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf2ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857203.176176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857203.176257:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863061888 00000100:00100000:1.0:1787857203.176267:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863061888 00010000:00010000:1.0:1787857203.176309:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857203.176346:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:1.0:1787857203.176357:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:2352:x1874703863061888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857203.176372:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857203.176379:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.176392:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 24 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.176410:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:1.0:1787857203.176414:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.176423:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.176431:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857203.176449:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857203.176563:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:2352:x1874703863061888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 207us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857203.176789:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00010000:00010000:2.0:1787857203.177297:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf2df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a9b expref: 23 pid: 8075 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857203.177315:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885080832:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857203.177336:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.177345:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.177351:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857203.177394:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787857203.177407:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857203.177430:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.177459:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf2f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aa2 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.177757:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aa2 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.177766:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857203.177769:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857203.177772:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84200, rc 0) 00000100:00100000:2.0:1787857203.177805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:11456:x1874703863061760:12345-192.168.204.29@tcp:101:bash.0 Request processed in 6444us (6817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857203.177812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 162 00000100:00100000:1.0:1787857203.180490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.180569:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863062144 00000100:00100000:3.0:1787857203.180585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863062144 00000100:00100000:3.0:1787857203.180641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:3.0:1787857203.180650:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:11456:x1874703863062144:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1787857203.180931:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11456:x1874703863062144:12345-192.168.204.29@tcp:35:bash.0 Request processed in 281us (448us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787857203.180955:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:0.0:1787857203.270478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.270556:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863062400 00000100:00100000:3.0:1787857203.270566:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863062400 00000100:00100000:3.0:1787857203.270713:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:3.0:1787857203.270724:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11466:x1874703863062400:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857203.270746:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857203.270767:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf302 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882aa9 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857203.271023:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787857203.271201:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf302 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aa9 expref: 25 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.271217:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:3.0:1787857203.271220:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857203.271226:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf302 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aa9 expref: 25 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.271253:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216dc00, rc 0) 00000100:00100000:3.0:1787857203.271320:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11466:x1874703863062400:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 597us (852us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787857203.271556:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:1.0:1787857203.280833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.281927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863062528 00000100:00100000:3.0:1787857203.281940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863062528 00000100:00100000:3.0:1787857203.282011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:3.0:1787857203.282021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11466:x1874703863062528:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1787857203.282115:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282134:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282145:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282170:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282185:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282526:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282536:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282544:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857203.282589:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282601:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282616:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282623:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282630:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857203.282634:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282642:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282654:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857203.282697:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857203.282702:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282709:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282722:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282727:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282732:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282736:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216de00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857203.282744:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282751:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282758:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd946159e00) 00010000:00010000:3.0:1787857203.282761:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857203.282764:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282769:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282781:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282786:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282792:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282797:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857203.282799:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282805:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282811:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857203.282813:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857203.282822:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.282829:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf31e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857203.282901:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b557480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11466:x1874703863062528:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 880us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.282909:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 164 00000100:00100000:1.0:1787857203.288011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.288091:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863062784 00000100:00100000:3.0:1787857203.288102:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863062784 00000100:00100000:3.0:1787857203.288171:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:3.0:1787857203.288182:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11466:x1874703863062784:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857203.289481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11466:x1874703863062784:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 1294us (1477us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787857203.289492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:1.0:1787857203.332963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.333074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063040 00000100:00100000:2.0:1787857203.333084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063040 00000100:00100000:2.0:1787857203.333194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:2.0:1787857203.333204:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11469:x1874703863063040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857203.333229:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857203.333251:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf325 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ab0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333342:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333370:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333382:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333400:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333406:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333413:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333861:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf33a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333871:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf33a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333878:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf33a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857203.333888:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787857203.333978:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333986:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.333993:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334006:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857203.334011:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334018:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334031:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857203.334034:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857203.334040:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334045:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf32c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334058:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334064:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334069:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334074:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857203.334077:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334082:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334100:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362800) 00010000:00010000:2.0:1787857203.334103:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857203.334106:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334112:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334154:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf325 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab0 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334180:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf33a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab0 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.334187:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857203.334189:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857203.334192:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857203.334567:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b556940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11469:x1874703863063040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1363us (1613us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787857203.334576:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 165 00000100:00100000:1.0:1787857203.338441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857203.338557:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063168 00000100:00100000:3.0:1787857203.338568:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063168 00000100:00100000:3.0:1787857203.338634:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:3.0:1787857203.338643:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b556580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11469:x1874703863063168:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1787857203.338740:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338759:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338771:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338798:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338804:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338826:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338833:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857203.338838:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338846:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338858:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857203.338861:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857203.338866:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857203.338872:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857203.338945:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b556580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11469:x1874703863063168:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 303us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857203.338955:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 166 00000100:00100000:3.0:1787857203.340908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.342306:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063424 00000100:00100000:2.0:1787857203.342319:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063424 00000100:00100000:2.0:1787857203.342384:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:2.0:1787857203.342394:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11469:x1874703863063424:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857203.342931:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11469:x1874703863063424:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 537us (2028us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787857203.342939:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:1.0:1787857203.344531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.347239:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063552 00000100:00100000:2.0:1787857203.347253:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063552 00000100:00100000:2.0:1787857203.347338:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857203.347347:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:2352:x1874703863063552:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857203.347366:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857203.347394:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf33a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab0 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.347413:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857203.347420:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857203.347505:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5561c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:2352:x1874703863063552:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 159us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857203.347520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1787857203.500285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857203.500412:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063808 00000100:00100000:0.0:1787857203.500424:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063808 00000100:00100000:0.0:1787857203.500501:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:0.0:1787857203.500522:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11487:x1874703863063808:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1787857203.500559:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857203.500582:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf34f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ab7 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.500717:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf356 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.500732:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.500745:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857203.500756:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787857203.500887:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf34f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab7 expref: 30 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.500906:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab7 expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.500928:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:0.0:1787857203.500931:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787857203.500935:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560a00, rc 0) 00000100:00100000:0.0:1787857203.500998:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11487:x1874703863063808:12345-192.168.204.29@tcp:101:cat.0 Request processed in 487us (724us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787857203.501005:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 167 00000100:00100000:1.0:1787857203.547376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.547481:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863063936 00000100:00100000:2.0:1787857203.547491:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863063936 00000100:00100000:2.0:1787857203.547569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:2.0:1787857203.547580:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11488:x1874703863063936:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857203.547604:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857203.547625:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882abe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.547753:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.547767:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.547779:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857203.547977:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787857203.547981:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857203.548064:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.548094:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882abe expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.548112:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882abe expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.548121:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857203.548125:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857203.548128:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84a00, rc 0) 00000100:00100000:2.0:1787857203.553060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b555680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11488:x1874703863063936:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5470us (5683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857203.553074:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 168 00000100:00100000:1.0:1787857203.557512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857203.557703:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064320 00000100:00100000:0.0:1787857203.557712:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064320 00000100:00100000:0.0:1787857203.557764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:0.0:1787857203.557773:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11488:x1874703863064320:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857203.558088:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11488:x1874703863064320:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 315us (586us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787857203.558096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:1.0:1787857203.565176:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857203.565273:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064448 00000100:00100000:2.0:1787857203.565282:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064448 00000100:00100000:2.0:1787857203.565346:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1787857203.565355:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11488:x1874703863064448:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:2.0:1787857203.565372:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787857203.565400:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf2fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aa2 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.565422:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ab7 expref: 30 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.565455:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf1ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a63 expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857203.565479:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857203.565489:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857203.565547:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11488:x1874703863064448:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 193us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857203.565555:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1787857203.569399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857203.569625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064576 00000100:00100000:0.0:1787857203.569636:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064576 00000100:00100000:0.0:1787857203.569735:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:0.0:1787857203.569745:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11488:x1874703863064576:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:0.0:1787857203.569890:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.569909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.569922:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857203.570291:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787857203.570961:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11488:x1874703863064576:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 1215us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857203.570970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 169 00000100:00100000:1.0:1787857203.587952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857203.588087:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064704 00000100:00100000:0.0:1787857203.588097:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064704 00000100:00100000:0.0:1787857203.588212:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 170 00000100:00100000:0.0:1787857203.588224:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11490:x1874703863064704:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857203.588246:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857203.588274:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ac5 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588354:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588371:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588383:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588399:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588406:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588424:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588893:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588903:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588910:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857203.588948:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787857203.588952:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857203.588971:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588983:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588991:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.588998:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589006:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589012:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857203.589016:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589023:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589045:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857203.589047:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857203.589052:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589058:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589073:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589079:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589085:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589090:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857203.589092:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589099:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589106:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447700) 00010000:00010000:0.0:1787857203.589109:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857203.589111:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589117:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589173:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 30 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589189:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857203.589196:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:0.0:1787857203.589198:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857203.589200:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857203.589274:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b557c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11490:x1874703863064704:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1052us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857203.589282:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 170 00010000:00010000:1.0:1787857203.655831:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857204.040103:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857204.040114:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857204.040170:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787857204.040185:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857204.040339:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885080960:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857204.040447:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94e145b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857204.041347:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857204.050248:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885081088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857204.050334:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857204.050410:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885081088 00000100:00100000:3.0:1787857204.050417:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885081088 00000100:00100000:3.0:1787857204.050465:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787857204.050474:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885081088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857204.050521:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857204.050564:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885081088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.050573:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787857204.050619:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787857204.050626:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787857204.050651:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fd842dce940 x1874703885080576/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787857219 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857204.050895:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885081088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857204.061041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.061106:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885080960:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857204.061296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064832 00000100:00100000:3.0:1787857204.061304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064832 00000100:00100000:3.0:1787857204.061360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:3.0:1787857204.061642:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11501:x1874703863064832:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857204.061718:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857204.061830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11501:x1874703863064832:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 192us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.071229:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 171 00000100:00100000:2.0:1787857204.074429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.074494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863064960 00000100:00100000:2.0:1787857204.074504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863064960 00000100:00100000:2.0:1787857204.074560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:2.0:1787857204.074572:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11501:x1874703863064960:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787857204.074649:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074701:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074726:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074734:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074741:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074774:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074782:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074789:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857204.074827:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787857204.074832:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857204.074845:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074856:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074863:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074870:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074886:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857204.074890:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074897:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074909:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:2.0:1787857204.074912:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857204.074917:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.074923:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf395 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075736:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075747:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075754:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075759:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857204.075763:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075770:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075793:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fd949362400) 00010000:00010000:2.0:1787857204.075796:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857204.075800:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075807:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf39c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075826:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075832:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075837:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075842:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857204.075845:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075850:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075858:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:2.0:1787857204.075861:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857204.075864:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.075870:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857204.077184:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11501:x1874703863064960:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 2604us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857204.077199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 172 00000100:00100000:0.0:1787857204.098573:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.098693:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863065216 00000100:00100000:1.0:1787857204.098703:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863065216 00000100:00100000:1.0:1787857204.098762:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:1.0:1787857204.098772:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11501:x1874703863065216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857204.098795:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857204.098817:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf3aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882acc expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.098919:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.098937:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.098969:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857204.098981:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787857204.099112:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099120:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099127:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099134:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857204.099139:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099161:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099174:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:1.0:1787857204.099177:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857204.099183:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099189:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf3b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099228:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf3aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882acc expref: 31 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099252:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:1.0:1787857204.099254:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857204.099259:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf3aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882acc expref: 31 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.099268:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978c00, rc 0) 00000100:00100000:1.0:1787857204.099328:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065216:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 558us (763us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787857204.099336:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 173 00000100:00100000:3.0:1787857204.110650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.117850:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863065344 00000100:00100000:1.0:1787857204.117863:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863065344 00000100:00100000:1.0:1787857204.117930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:1.0:1787857204.117939:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065344:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787857204.117971:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787857204.118080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065344:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 142us (7443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.118088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 174 00000100:00100000:0.0:1787857204.125823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.128852:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863065600 00000100:00100000:2.0:1787857204.128866:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863065600 00000100:00100000:2.0:1787857204.128946:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:2.0:1787857204.128959:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065600:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857204.128982:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857204.128986:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787857204.129014:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf36b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882abe expref: 30 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.129036:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857204.129041:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857204.129055:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ad3 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857204.130194:0:8075:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787857204.132736:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf3c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.132760:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.132772:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.132868:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf3bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ad3 expref: 32 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.132895:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ad3 expref: 31 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.132904:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd949362400) 00010000:00010000:2.0:1787857204.132907:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857204.132910:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84400, rc 0) 00000100:00100000:2.0:1787857204.133155:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11501:x1874703863065600:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 4187us (7329us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787857204.133165:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 175 00000100:00100000:1.0:1787857204.142648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.143521:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863065856 00000100:00100000:3.0:1787857204.143534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863065856 00000100:00100000:3.0:1787857204.143606:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:3.0:1787857204.143618:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11501:x1874703863065856:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.143803:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857204.143838:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf3c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ad3 expref: 31 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143857:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd949362400) 00010000:00010000:3.0:1787857204.143867:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857204.143891:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143904:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143913:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143927:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143934:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.143939:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144227:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144237:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144246:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144252:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.144263:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144272:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144282:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857204.144284:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.144289:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144295:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf3d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144307:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144313:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144318:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144323:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216de00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.144326:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144332:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144339:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8d8fd131 (ffff9fd946159e00) 00010000:00010000:3.0:1787857204.144342:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.144351:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.144357:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf3db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8fd131 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.144454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065856:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 837us (1818us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857204.144462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 176 00000100:00100000:0.0:1787857204.147025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.147148:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863065984 00000100:00100000:3.0:1787857204.147158:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863065984 00000100:00100000:3.0:1787857204.147218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 177 00000100:00100000:3.0:1787857204.147229:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11501:x1874703863065984:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.147249:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857204.147270:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf3e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ada expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147309:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147323:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147333:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf3e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147450:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.147465:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:3.0:1787857204.147468:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857204.147472:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d600, rc 0) 00000100:00100000:3.0:1787857204.147540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11501:x1874703863065984:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 312us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.147547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 177 00000100:00100000:2.0:1787857204.151097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.151210:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863066240 00000100:00100000:3.0:1787857204.151219:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863066240 00000100:00100000:3.0:1787857204.151275:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 178 00000100:00100000:3.0:1787857204.151285:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+31:11501:x1874703863066240:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.151369:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.151389:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.151400:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857204.151739:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787857204.151750:0:8856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358480089142ns, next at 359480086066ns, rc = 0 00000004:00010000:3.0:1787857204.151839:0:8856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8261284 reply state 000000009a88c590 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.151849:0:8856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857204.151935:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11501:x1874703863066240:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 650us (849us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787857204.151955:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 178 00010000:00010000:3.0:1787857204.153477:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153493:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153503:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153510:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.153515:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153525:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153540:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:3.0:1787857204.153544:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857204.153549:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.153555:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf3f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.162047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.162118:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863066368 00000100:00100000:0.0:1787857204.162128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863066368 00000100:00100000:0.0:1787857204.162198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 179 00000100:00100000:0.0:1787857204.162209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:11501:x1874703863066368:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857204.162234:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857204.162259:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ae1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.162332:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.162367:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.162388:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:0.0:1787857204.162391:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787857204.162395:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857204.162471:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11501:x1874703863066368:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 264us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857204.162478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 179 00000100:00100000:0.0:1787857204.165396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.165475:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863066496 00000100:00100000:3.0:1787857204.165485:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863066496 00000100:00100000:3.0:1787857204.165559:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:3.0:1787857204.165570:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863066496:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787857204.165925:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863066496:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 356us (542us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787857204.165942:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00080000:0.0:1787857204.166004:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857204.172116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.172208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863066752 00000100:00100000:0.0:1787857204.172220:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863066752 00000100:00100000:0.0:1787857204.172287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857204.172298:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11501:x1874703863066752:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787857204.172545:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11501:x1874703863066752:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 248us (438us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787857204.172553:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1787857204.174847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.175021:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067008 00000100:00100000:0.0:1787857204.175030:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067008 00000100:00100000:0.0:1787857204.175085:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 180 00000100:00100000:0.0:1787857204.175094:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11501:x1874703863067008:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857204.175219:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11501:x1874703863067008:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857204.175237:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 180 00000100:00100000:1.0:1787857204.187127:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.187235:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067136 00000100:00100000:2.0:1787857204.187245:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067136 00000100:00100000:2.0:1787857204.187345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 181 00000100:00100000:2.0:1787857204.187357:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11501:x1874703863067136:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857204.187380:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857204.187403:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf3fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ae8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187483:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187499:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187511:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857204.187627:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857204.187649:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187780:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf3fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae8 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187798:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae8 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.187807:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:2.0:1787857204.187810:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787857204.187814:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857204.187913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11501:x1874703863067136:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 557us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857204.187921:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 181 00000100:00100000:0.0:1787857204.193988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.194110:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067264 00000100:00100000:1.0:1787857204.194120:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067264 00000100:00100000:1.0:1787857204.194190:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:1.0:1787857204.194201:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863067264:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857204.194237:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857204.194258:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882aef expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857204.194286:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908933, blocks: 0x1 00010000:00010000:1.0:1787857204.194306:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787857204.194311:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857204.194320:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.194340:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.194355:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978600, rc 0) 00000100:00100000:1.0:1787857204.194466:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863067264:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 267us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.194473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:1.0:1787857204.197631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.197800:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067520 00000100:00100000:3.0:1787857204.197810:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067520 00000100:00100000:3.0:1787857204.197896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 182 00000100:00100000:3.0:1787857204.197905:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11501:x1874703863067520:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787857204.198064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11501:x1874703863067520:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 160us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.198072:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 182 00000100:00100000:1.0:1787857204.200969:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.201070:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067648 00000100:00100000:3.0:1787857204.201079:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067648 00000100:00100000:3.0:1787857204.201182:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1787857204.201192:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:11501:x1874703863067648:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.201211:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857204.201231:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882af6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.201282:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.201296:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857204.201301:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857204.201306:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.201366:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.201381:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.201402:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885081216:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857204.201619:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96d999b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857204.205000:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885081216:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857204.205047:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.205068:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857204.205415:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:11501:x1874703863067648:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 4222us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.205425:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:1.0:1787857204.205616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.205691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067776 00000100:00100000:0.0:1787857204.205700:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067776 00010000:00010000:0.0:1787857204.205742:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.205788:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:0.0:1787857204.205800:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863067776:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857204.205817:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857204.205845:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.205861:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.205889:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c254fd3/0xf326646fe3bbf40c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882aef expref: 9 pid: 6676 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.205907:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857204.205911:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857204.205920:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.205931:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.205985:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.206004:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa59680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885081344:192.168.204.29@tcp:105: 00000100:00100000:0.0:1787857204.206083:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857204.208636:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa59680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885081344:192.168.204.29@tcp:105: 00010000:00010000:0.0:1787857204.208704:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857204.208763:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863067776:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 2964us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857204.209094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.209178:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863067904 00000100:00100000:3.0:1787857204.209188:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863067904 00002000:00100000:3.0:1787857204.209249:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fd842dcf840 x1874703863067904/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:605/0 lens 504/0 e 0 to 0 dl 1787857215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857204.209261:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd842dcf840 with x1874703863067904 ext(0->8) 00002000:00010000:3.0:1787857204.209266:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd842dcf840 00000100:00100000:3.0:1787857204.209301:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1787857204.209326:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863067904:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787857204.209594:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:3.0:1787857204.209830:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863067904:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 505us (735us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787857204.209838:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00002000:00100000:3.0:1787857204.209845:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fd842dcf840 x1874703863067904/t4294967314(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:605/0 lens 504/448 e 0 to 0 dl 1787857215 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857204.209854:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd842dcf840 with x1874703863067904 ext(0->8) 00002000:00010000:3.0:1787857204.209858:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd842dcf840 00000100:00100000:1.0:1787857204.212333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.212517:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068032 00000100:00100000:2.0:1787857204.212527:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068032 00000100:00100000:2.0:1787857204.212594:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 183 00000100:00100000:2.0:1787857204.212605:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11501:x1874703863068032:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787857204.239249:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787857204.239274:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1787857204.239306:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1787857204.239524:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857204.239546:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885081472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787857204.239633:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857204.239714:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885081472 00000100:00100000:2.0:1787857204.239721:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885081472 00000100:00100000:2.0:1787857204.239780:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787857204.239792:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885081472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857204.240053:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787857204.240057:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787857203 00002000:00010000:2.0:1787857204.240060:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857204.240062:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787857203 -> 1787857203 00002000:00010000:2.0:1787857204.240064:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857204.240116:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874703885081472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 326us (482us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787857204.240124:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787857204.242386:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd842dcde00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787857204.242398:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885081472:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1787857204.242473:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787857204.242486:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787857204.251740:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11501:x1874703863068032:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 39128us (39407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.251757:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 183 00000100:00100000:1.0:1787857204.255325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.255373:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068160 00000100:00100000:1.0:1787857204.255392:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068160 00000100:00100000:1.0:1787857204.255452:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:1.0:1787857204.255463:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863068160:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787857204.337074:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863068160:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 81603us (81750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.337089:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000001:00080000:3.0:1787857204.337488:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1787857204.337500:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1787857204.349174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.350268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068416 00000100:00100000:0.0:1787857204.350282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068416 00000100:00100000:0.0:1787857204.350363:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 184 00000100:00100000:0.0:1787857204.350373:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11501:x1874703863068416:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857204.350610:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857204.350640:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.350678:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:0.0:1787857204.350697:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857204.350807:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.350822:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.350832:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857204.351096:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095752dbd reply state 000000006cc0e03e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.351106:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857204.351270:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11501:x1874703863068416:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 898us (2106us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787857204.351277:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 184 00000100:00100000:2.0:1787857204.367045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.367093:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068544 00000100:00100000:2.0:1787857204.367104:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068544 00000100:00100000:2.0:1787857204.367166:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:2.0:1787857204.367176:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863068544:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.367453:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.367466:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857204.367471:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00010000:00010000:3.0:1787857204.367474:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857204.367477:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787857203 -> 1787857202 00002000:00010000:2.0:1787857204.367485:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787857201 00010000:00010000:3.0:1787857204.367489:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00002000:00010000:2.0:1787857204.367490:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787857203 -> 1787857202 00002000:00010000:2.0:1787857204.367495:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787857204.367497:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.367508:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.367528:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:3.0:1787857204.367539:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.367546:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.367552:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf41a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857204.367574:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863068544:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 397us (541us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787857204.367583:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:1.0:1787857204.373682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.373730:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068800 00000100:00100000:3.0:1787857204.373741:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068800 00000100:00100000:3.0:1787857204.373805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 185 00000100:00100000:3.0:1787857204.373816:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11501:x1874703863068800:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857204.373886:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.373904:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.373914:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.373950:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.373964:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 19 pid: 5838 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.373980:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885081600:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857204.374072:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857204.378434:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885081600:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857204.378465:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.379030:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.379215:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863068928 00000100:00100000:3.0:1787857204.379230:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863068928 00010000:00010000:3.0:1787857204.379265:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 20 pid: 5838 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.379351:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:3.0:1787857204.379361:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2353:x1874703863068928:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857204.379379:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857204.379387:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 20 pid: 5838 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379399:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 20 pid: 5838 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379421:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf3e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ada expref: 20 pid: 5838 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379435:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:3.0:1787857204.379440:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379450:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379459:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.379499:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857204.379551:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:2353:x1874703863068928:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 190us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.379568:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00010000:00010000:2.0:1787857204.379734:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379755:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379785:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379794:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379800:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379817:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857204.379823:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379831:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379841:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:2.0:1787857204.379844:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787857204.379849:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.379855:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857204.379906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+18:11501:x1874703863068800:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 6092us (6248us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787857204.379915:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 185 00000100:00100000:1.0:1787857204.393887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.394200:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069056 00000100:00100000:0.0:1787857204.394212:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069056 00000100:00100000:0.0:1787857204.394327:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:0.0:1787857204.394340:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863069056:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857204.394392:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.394416:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.394425:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857204.394429:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857204.394458:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.394501:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.394527:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 8 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.394544:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885081728:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857204.394648:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948942e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857204.407426:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885081728:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857204.407454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:3.0:1787857204.407468:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.407537:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069184 00000100:00100000:0.0:1787857204.407544:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069184 00010000:00010000:0.0:1787857204.407585:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.407732:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:0.0:1787857204.407743:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863069184:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857204.407758:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857204.407781:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.407796:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.407820:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbf413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882af6 expref: 9 pid: 6679 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.407846:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857204.407851:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857204.407857:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.407867:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.407895:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857204.407958:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863069184:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 216us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857204.407966:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00010000:00010000:3.0:1787857204.408492:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408502:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408530:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408538:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408546:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408553:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857204.408557:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408567:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408590:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.408598:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9221f5/0xf326646fe3bbf428 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.408680:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863069056:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 14320us (14781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.408757:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:2.0:1787857204.416692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.416726:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069440 00000100:00100000:1.0:1787857204.416743:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069440 00000100:00100000:1.0:1787857204.416808:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 186 00000100:00100000:1.0:1787857204.416820:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+18:11501:x1874703863069440:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787857204.417274:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417298:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417312:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417575:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417587:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417596:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417644:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.417723:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 19 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.417739:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885081856:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857204.417866:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857204.421313:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fa58b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885081856:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857204.421343:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.425012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.425089:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069568 00000100:00100000:1.0:1787857204.425100:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069568 00010000:00010000:1.0:1787857204.425155:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 20 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.425195:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:1.0:1787857204.425205:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2353:x1874703863069568:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857204.425221:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857204.425228:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 20 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425250:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 20 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425275:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf3f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ae1 expref: 20 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425300:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:1.0:1787857204.425305:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425314:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425321:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425350:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857204.425408:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:2353:x1874703863069568:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 204us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.425417:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00010000:00010000:1.0:1787857204.425446:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.425453:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857204.425635:0:8856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787857204.427011:0:8856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787857204.427071:0:8856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787857204.427192:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8856:1874703885081984:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787857204.427267:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857204.427316:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857204.427413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885081984 00000100:00100000:2.0:1787857204.427422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885081984 00000100:00100000:2.0:1787857204.427483:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787857204.427494:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8856:x1874703885081984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857204.427582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8856:x1874703885081984:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857204.427588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857204.427967:0:8856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787857204.427973:0:8856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd842dcde00, transno 4294967315 00000100:00100000:1.0:1787857204.427989:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8856:1874703885081984:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1787857204.428533:0:8856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787857204.428602:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8856:1874703885082112:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787857204.428654:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857204.428715:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857204.428793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885082112 00000100:00100000:2.0:1787857204.428800:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885082112 00000100:00100000:2.0:1787857204.428856:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787857204.428867:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8856:x1874703885082112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787857204.429061:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8856:x1874703885082112:12345-0@lo:1000:mdt00_004.0 Request processed in 196us (406us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787857204.429069:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857204.430860:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8856:1874703885082112:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787857204.430905:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430916:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430923:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430929:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857204.430933:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430941:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430959:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd946159600) 00010000:00010000:1.0:1787857204.430962:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857204.430976:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.430983:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf436 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431015:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431022:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431027:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431032:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857204.431035:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431040:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431049:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:1.0:1787857204.431051:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857204.431055:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431060:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf372 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431087:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431102:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 22 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431117:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431164:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 22 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.431181:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 22 pid: 8856 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.432294:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c00f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885082240:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857204.432461:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857204.435692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.435792:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069696 00000100:00100000:1.0:1787857204.435802:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069696 00010000:00010000:1.0:1787857204.435846:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 23 pid: 8856 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.435892:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:1.0:1787857204.435904:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:2352:x1874703863069696:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857204.435920:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857204.435926:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 23 pid: 8856 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.435944:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 23 pid: 8856 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.435970:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:1.0:1787857204.435976:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.435993:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.436006:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.436031:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857204.436096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:2352:x1874703863069696:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 194us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.436104:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00010000:00010000:0.0:1787857204.436208:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf38e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ac5 expref: 22 pid: 8856 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.436224:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c00f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885082240:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857204.436247:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436269:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436276:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436288:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436295:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436331:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436338:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.436342:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436357:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436368:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:0.0:1787857204.436371:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.436375:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436382:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979800/0xf326646fe3bbf43d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436393:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436400:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436405:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436410:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.436413:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436429:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436437:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd953447400) 00010000:00010000:0.0:1787857204.436439:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787857204.436454:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.436460:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf42f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857204.437412:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857204.437420:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857204.437970:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787857204.437978:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857204.438172:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11501:x1874703863069440:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 21349us (21485us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787857204.438183:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 186 00000020:00080000:0.0:1787857204.438189:0:8856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787857204.452122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.457033:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863069952 00000100:00100000:1.0:1787857204.457051:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863069952 00000100:00100000:1.0:1787857204.457123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:1.0:1787857204.457145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d465850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11501:x1874703863069952:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1787857204.457711:0:12397:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787857204.457717:0:12397:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787857204.457793:0:12397:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787857204.457798:0:12397:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:1.0:1787857204.458003:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787857204.458150:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787857204.458208:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458225:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458238:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458247:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458253:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458267:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458287:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857204.458386:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d465850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11501:x1874703863069952:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1251us (6272us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787857204.458396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000020:00080000:1.0:1787857204.458403:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857204.458469:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857204.458477:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458484:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857204.458488:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458497:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458511:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fd963a5f600) 00010000:00010000:1.0:1787857204.458514:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857204.458520:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458527:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf444 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.458543:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857204.458547:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857204.458549:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857204.669832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.669869:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863070208 00000100:00100000:0.0:1787857204.669879:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863070208 00000100:00100000:0.0:1787857204.669934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 187 00000100:00100000:0.0:1787857204.669943:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:11512:x1874703863070208:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857204.669966:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857204.669985:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882afd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.670254:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf452 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.670268:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.670288:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf452 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857204.670300:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787857204.670476:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882afd expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.670495:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf452 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882afd expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.670504:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857204.670507:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787857204.670511:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560800, rc 0) 00000100:00100000:0.0:1787857204.670571:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11512:x1874703863070208:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 628us (747us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787857204.670578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 187 00010000:00010000:2.0:1787857204.682362:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857204.693889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.695078:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863070336 00000100:00100000:3.0:1787857204.695090:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863070336 00000100:00100000:3.0:1787857204.695163:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:3.0:1787857204.695175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11512:x1874703863070336:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:3.0:1787857204.695249:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.695267:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.695279:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.695302:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.695311:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.695318:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697222:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697239:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697248:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857204.697293:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697307:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697313:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697320:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697325:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.697329:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697345:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697358:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857204.697361:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.697365:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697371:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697394:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697399:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697405:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697410:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.697412:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697418:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.697426:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd946159e00) 00010000:00010000:3.0:1787857204.697429:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.697432:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699002:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf467 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699030:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699036:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699044:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699049:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.699052:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699058:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699071:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159200) 00010000:00010000:3.0:1787857204.699074:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.699078:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.699083:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf46e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.699195:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11512:x1874703863070336:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 4018us (5310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857204.699206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 188 00000100:00100000:0.0:1787857204.751866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.752970:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863070592 00000100:00100000:2.0:1787857204.754019:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863070592 00000100:00100000:3.0:1787857204.754192:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:3.0:1787857204.754205:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fa58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11515:x1874703863070592:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857204.754227:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857204.754252:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b04 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754327:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754342:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754352:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754367:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754375:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754382:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754776:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754786:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.754793:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857204.754812:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787857204.755106:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755115:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755122:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755165:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.755171:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755180:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755193:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857204.755197:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.755202:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755208:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755221:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755228:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755244:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755249:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857204.755252:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755257:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755265:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd946159200) 00010000:00010000:3.0:1787857204.755268:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857204.755271:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755276:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755318:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 28 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755332:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 27 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.755339:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:3.0:1787857204.755341:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857204.755343:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216d600, rc 0) 00000100:00100000:3.0:1787857204.755425:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fa58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11515:x1874703863070592:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1223us (3576us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787857204.755442:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 189 00000100:00100000:0.0:1787857204.760278:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.760521:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863070720 00000100:00100000:1.0:1787857204.760530:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863070720 00000100:00100000:1.0:1787857204.760592:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 190 00000100:00100000:1.0:1787857204.760603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11515:x1874703863070720:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:1.0:1787857204.760701:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760717:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760730:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760758:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760765:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760771:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760777:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857204.760782:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760789:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760802:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:1.0:1787857204.760804:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787857204.760809:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.760843:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978e00/0xf326646fe3bbf498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.761409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11515:x1874703863070720:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 807us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.761417:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 190 00000100:00100000:2.0:1787857204.764473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.764619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863070976 00000100:00100000:0.0:1787857204.764630:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863070976 00000100:00100000:0.0:1787857204.764876:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:0.0:1787857204.764898:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11515:x1874703863070976:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857204.765180:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11515:x1874703863070976:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 283us (717us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787857204.765188:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:0.0:1787857204.806574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857204.806682:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863071232 00000100:00100000:3.0:1787857204.806692:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863071232 00000100:00100000:3.0:1787857204.806814:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 191 00000100:00100000:3.0:1787857204.806824:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11049:x1874703863071232:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1787857204.806951:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857204.806975:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf49f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b0b expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.807145:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.807164:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.807173:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.807211:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 29 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.807226:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 29 pid: 8856 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.807241:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd9602b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885082368:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857204.807378:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787857204.811491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.811604:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863071360 00000100:00100000:1.0:1787857204.811615:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863071360 00010000:00010000:1.0:1787857204.811708:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 30 pid: 8856 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.811751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:1.0:1787857204.811761:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:2354:x1874703863071360:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857204.811777:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857204.811784:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 30 pid: 8856 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.811798:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 30 pid: 8856 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.811823:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:1.0:1787857204.811839:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.811855:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.811864:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.811908:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857204.811958:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:2354:x1874703863071360:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 198us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.811967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00010000:00010000:3.0:1787857204.812296:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf48a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b04 expref: 29 pid: 8856 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.812322:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd9602b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8075:1874703885082368:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857204.812346:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.812355:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857204.812361:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857204.812380:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787857204.813381:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf49f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 30 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.813403:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 29 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.813412:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:2.0:1787857204.813415:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787857204.813418:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:2.0:1787857204.813700:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11049:x1874703863071232:12345-192.168.204.29@tcp:101:bash.0 Request processed in 6875us (7134us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787857204.813709:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 191 00000100:00100000:2.0:1787857204.817649:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.817821:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863071616 00000100:00100000:0.0:1787857204.818081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863071616 00000100:00100000:0.0:1787857204.818191:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 192 00000100:00100000:0.0:1787857204.818202:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11049:x1874703863071616:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:0.0:1787857204.818523:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.818541:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.818552:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857204.818610:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787857204.818638:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c01ebf69 reply state 00000000ab000acf transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.818647:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787857204.818734:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787857204.818863:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11049:x1874703863071616:12345-192.168.204.29@tcp:36:bash.0 Request processed in 662us (1223us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787857204.818870:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 192 00000020:00080000:0.0:1787857204.818885:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787857204.821855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.822001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863071744 00000100:00100000:1.0:1787857204.822011:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863071744 00000100:00100000:1.0:1787857204.822068:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 193 00000100:00100000:1.0:1787857204.822078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11049:x1874703863071744:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857204.822100:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857204.822120:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbf4bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.822192:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbf4bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b12 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.822208:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbf4bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b12 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.822228:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:1.0:1787857204.822232:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857204.822236:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979e00, rc 0) 00000100:00100000:1.0:1787857204.822300:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+34:11049:x1874703863071744:12345-192.168.204.29@tcp:101:bash.0 Request processed in 223us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.822307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 193 00010000:00010000:2.0:1787857204.825583:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825604:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825612:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825619:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857204.825624:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825633:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825686:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:2.0:1787857204.825689:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857204.825695:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.825701:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.827527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.827692:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863071872 00000100:00100000:2.0:1787857204.827703:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863071872 00000100:00100000:2.0:1787857204.827765:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:2.0:1787857204.827777:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:11049:x1874703863071872:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857204.827799:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857204.827822:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b19 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857204.827872:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a908932, atime: 0x6a908931, ctime: 0x6a908932, blocks: 0xb 00010000:00010000:2.0:1787857204.827903:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1787857204.827908:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857204.827916:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.827933:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857204.827946:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84800, rc 0) 00000100:00100000:2.0:1787857204.828019:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:11049:x1874703863071872:12345-192.168.204.29@tcp:101:bash.0 Request processed in 245us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857204.828039:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:3.0:1787857204.831474:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857204.831759:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072000 00000100:00100000:2.0:1787857204.831769:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072000 00002000:00010000:2.0:1787857204.831812:0:6684:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787857204.831818:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd9602b4780 with x1874703863072000 ext(0->18446744073709551615) 00002000:00010000:2.0:1787857204.831830:0:6684:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd9602b4780. 00000100:00100000:2.0:1787857204.831863:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1787857204.831881:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863072000:12345-192.168.204.29@tcp:10:bash.0 00002000:00010000:2.0:1787857204.832300:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787857204.832305:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787857202 -> 1787857204 00002000:00010000:2.0:1787857204.832308:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787857201 -> 1787857201 00002000:00010000:2.0:1787857204.832310:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787857202 -> 1787857204 00002000:00010000:2.0:1787857204.832312:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787857204.832386:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2353:x1874703863072000:12345-192.168.204.29@tcp:10:bash.0 Request processed in 514us (932us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787857204.832397:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00002000:00010000:2.0:1787857204.832401:0:6684:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787857204.832404:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd9602b4780 with x1874703863072000 ext(0->18446744073709551615) 00002000:00010000:2.0:1787857204.832409:0:6684:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd9602b4780. 00000100:00100000:3.0:1787857204.907101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.907630:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072128 00000100:00100000:0.0:1787857204.907640:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072128 00000100:00100000:0.0:1787857204.907862:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:0.0:1787857204.907872:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11529:x1874703863072128:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1787857204.907953:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908006:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908017:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908033:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908040:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908047:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908369:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908379:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908387:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857204.908425:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908435:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908442:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908459:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908466:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.908470:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908477:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908489:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857204.908492:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.908497:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908503:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908516:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908521:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908528:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908533:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.908536:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908551:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908559:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447400) 00010000:00010000:0.0:1787857204.908562:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.908565:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908570:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908586:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908593:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908600:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908604:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.908607:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908613:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908621:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:0.0:1787857204.908623:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.908627:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.908641:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.910138:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11529:x1874703863072128:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 2249us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857204.910151:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 194 00000100:00100000:1.0:1787857204.956185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.956966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072384 00000100:00100000:0.0:1787857204.956989:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072384 00000100:00100000:0.0:1787857204.957062:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 195 00000100:00100000:0.0:1787857204.957074:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+33:11532:x1874703863072384:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857204.957108:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857204.957140:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957213:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957228:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957239:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957255:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957261:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957281:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957625:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf4f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957636:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957644:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857204.957653:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787857204.957796:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957805:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957811:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957817:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.957821:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957829:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957840:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857204.957843:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.957865:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957871:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf4e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957883:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957889:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957894:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957899:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.957902:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957907:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957913:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447400) 00010000:00010000:0.0:1787857204.957916:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857204.957918:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957923:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf4ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957960:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf4de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b20 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957984:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b20 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.957991:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:0.0:1787857204.957993:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857204.957996:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561a00, rc 0) 00000100:00100000:0.0:1787857204.958060:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11532:x1874703863072384:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 989us (1886us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787857204.958068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 195 00000100:00100000:3.0:1787857204.963892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857204.964362:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072512 00000100:00100000:0.0:1787857204.964374:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072512 00000100:00100000:0.0:1787857204.964452:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:0.0:1787857204.964464:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11532:x1874703863072512:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857204.964541:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.964559:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 35 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.964568:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.964601:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 35 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.964616:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 35 pid: 8075 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.964645:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b554780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885082496:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857204.964855:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857204.972515:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b554780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885082496:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857204.972547:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857204.983276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.983404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072768 00000100:00100000:1.0:1787857204.983414:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072768 00000100:00100000:1.0:1787857204.983482:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:1.0:1787857204.983492:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:5591:x1874703863072768:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787857204.985159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:5591:x1874703863072768:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 1658us (1884us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787857204.985172:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:3.0:1787857204.990053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857204.990449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863072896 00000100:00100000:1.0:1787857204.990460:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863072896 00010000:00010000:1.0:1787857204.990506:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 37 pid: 8075 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857204.990548:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 74 00000100:00100000:1.0:1787857204.990556:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:2352:x1874703863072896:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857204.990574:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857204.990580:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 37 pid: 8075 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990594:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 37 pid: 8075 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990616:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf4a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b0b expref: 37 pid: 8075 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990633:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:1.0:1787857204.990638:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990707:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990715:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857204.990743:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857204.990792:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:2352:x1874703863072896:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 237us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857204.990799:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 74 00010000:00010000:0.0:1787857204.991106:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991115:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991158:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991165:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991172:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991177:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857204.991181:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991190:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991200:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:0.0:1787857204.991210:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857204.991217:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857204.991224:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857204.991273:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11532:x1874703863072512:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 26811us (27392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857204.991282:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 196 00000100:00100000:2.0:1787857205.002060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.002297:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863073152 00000100:00100000:0.0:1787857205.002375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863073152 00000100:00100000:0.0:1787857205.002510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:0.0:1787857205.002523:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+35:11532:x1874703863073152:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:0.0:1787857205.002838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11532:x1874703863073152:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 306us (777us total) trans 4294967478 rc 0/0 00000100:00080000:2.0:1787857205.004990:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857205.005934:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1787857205.137738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.137934:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863073408 00000100:00100000:0.0:1787857205.137944:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863073408 00000100:00100000:0.0:1787857205.138013:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 197 00000100:00100000:0.0:1787857205.138024:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+36:11543:x1874703863073408:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:0.0:1787857205.138049:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857205.138070:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b27 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138170:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138186:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138213:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138229:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138236:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138244:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138808:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf51d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138819:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138827:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857205.138836:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787857205.138934:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138942:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138948:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138954:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.138965:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138972:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138984:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857205.138987:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.138991:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.138997:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf50f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139010:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139016:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139021:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139025:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.139027:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139032:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139038:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447400) 00010000:00010000:0.0:1787857205.139041:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.139050:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139055:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139100:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b27 expref: 39 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139115:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b27 expref: 38 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.139133:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:0.0:1787857205.139136:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857205.139138:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857205.139482:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:11543:x1874703863073408:12345-192.168.204.29@tcp:101:cat.0 Request processed in 1458us (1752us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787857205.139490:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 197 00000100:00100000:3.0:1787857205.148585:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.149725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863073664 00000100:00100000:1.0:1787857205.149738:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863073664 00000100:00100000:1.0:1787857205.149860:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:1.0:1787857205.149872:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:11543:x1874703863073664:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:1.0:1787857205.150304:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11543:x1874703863073664:12345-192.168.204.29@tcp:35:cat.0 Request processed in 432us (1727us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787857205.150312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 54 00000100:00100000:2.0:1787857205.187911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.188013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863073920 00000100:00100000:1.0:1787857205.188023:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863073920 00000100:00100000:1.0:1787857205.188091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 198 00000100:00100000:1.0:1787857205.188102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11544:x1874703863073920:12345-192.168.204.29@tcp:36:rm.0 00010000:00010000:1.0:1787857205.188172:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787857205.188203:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf51d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b27 expref: 39 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188227:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf4f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b20 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbf4bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b12 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188266:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd946159e00) 00010000:00010000:1.0:1787857205.188276:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857205.188301:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188313:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188322:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188335:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188340:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.188346:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.189350:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.189362:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.189369:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857205.198820:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787857205.198835:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359527174475ns, next at 360527170745ns, rc = 0 00010000:00010000:0.0:1787857205.198912:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198930:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198942:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198951:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198966:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198973:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.198998:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857205.199022:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199029:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199035:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199041:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.199045:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199052:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199064:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5fb00) 00010000:00010000:0.0:1787857205.199067:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787857205.199072:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199091:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf539 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199110:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199135:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199140:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199145:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.199149:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199155:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199164:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857205.199166:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.199170:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.199176:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf52b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857205.199188:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcd23bfb reply state 00000000e95f7748 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857205.199196:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857205.199297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+38:11544:x1874703863073920:12345-192.168.204.29@tcp:36:rm.0 Request processed in 11193us (11391us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787857205.199307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 198 00010000:00010000:2.0:1787857205.199977:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857205.199986:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.200004:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857205.200007:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.200014:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.200025:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fd963a5fb00) 00010000:00010000:2.0:1787857205.200028:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787857205.200031:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.200037:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.200055:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857205.200056:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857205.200058:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857205.207324:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207362:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207369:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207376:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.207381:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207390:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207409:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd963a5f600) 00010000:00010000:0.0:1787857205.207413:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.207418:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.207426:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979a00/0xf326646fe3bbf532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.336372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.336867:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074176 00000100:00100000:0.0:1787857205.336878:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074176 00000100:00100000:0.0:1787857205.336945:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 199 00000100:00100000:0.0:1787857205.336955:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+37:11550:x1874703863074176:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857205.336981:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857205.337002:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf547 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b2e expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.337654:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.338689:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.338706:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.339540:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.339553:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.339563:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857205.340172:0:8856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787857205.340335:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340352:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340361:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340397:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340404:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340410:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.340415:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857205.340419:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.344715:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.344747:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857205.344750:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857205.344757:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.344764:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf54e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857205.344789:0:8856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb244033 reply state 00000000627742f8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.344816:0:8856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787857205.344875:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf547 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 40 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.344892:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 39 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.344900:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:2.0:1787857205.344902:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857205.344904:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84a00, rc 0) 00000100:00100000:2.0:1787857205.345072:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:11550:x1874703863074176:12345-192.168.204.29@tcp:101:bash.0 Request processed in 8108us (8700us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787857205.345081:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 199 00010000:00010000:2.0:1787857205.365734:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365753:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365762:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365768:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857205.365773:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365781:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365822:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362300) 00010000:00010000:2.0:1787857205.365825:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857205.365831:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.365837:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbf555 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.371809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.371959:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074304 00000100:00100000:1.0:1787857205.371970:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074304 00000100:00100000:1.0:1787857205.372041:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:1.0:1787857205.372052:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863074304:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:1.0:1787857205.372082:0:8078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857205.372103:0:8078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b35 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857205.372142:0:8078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787857205.372175:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787857205.372180:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857205.372189:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 6 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.372209:0:8078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 6 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.372222:0:8078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979e00, rc 0) 00000100:00100000:1.0:1787857205.372280:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863074304:12345-192.168.204.29@tcp:101:bash.0 Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857205.372286:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00080000:0.0:1787857205.372546:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857205.375937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.376045:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074432 00000100:00100000:2.0:1787857205.376054:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074432 00000100:00100000:2.0:1787857205.376137:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1787857205.376158:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:11550:x1874703863074432:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857205.376175:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.376193:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b3c expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.376226:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.376235:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857205.376240:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857205.376245:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.376279:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.376310:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.376324:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874703885082624:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857205.376413:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857205.380167:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1874703885082624:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857205.380206:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.380227:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85800, rc 0) 00000100:00100000:2.0:1787857205.380351:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975a470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:11550:x1874703863074432:12345-192.168.204.29@tcp:101:bash.0 Request processed in 4203us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.380360:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:1.0:1787857205.390275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.390832:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074560 00000100:00100000:2.0:1787857205.390846:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074560 00010000:00010000:2.0:1787857205.390891:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.390943:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:2.0:1787857205.390953:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863074560:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857205.390971:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857205.390992:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.391030:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.391056:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbf56a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b35 expref: 7 pid: 8078 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.391071:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857205.391076:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857205.391084:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.391095:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.391148:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.391165:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874703885082752:192.168.204.29@tcp:105: 00000100:00100000:2.0:1787857205.391257:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787857205.395715:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981ee0780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5823:1874703885082752:192.168.204.29@tcp:105: 00010000:00010000:2.0:1787857205.395745:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857205.395796:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2352:x1874703863074560:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4844us (5531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.395807:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:0.0:1787857205.407529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857205.407700:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074816 00000100:00100000:3.0:1787857205.407709:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074816 00000100:00100000:3.0:1787857205.407770:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:3.0:1787857205.407781:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+39:11550:x1874703863074816:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:3.0:1787857205.408231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:11550:x1874703863074816:12345-192.168.204.29@tcp:35:bash.0 Request processed in 451us (715us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787857205.408257:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 55 00000100:00100000:0.0:1787857205.622458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.622626:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863074944 00000100:00100000:2.0:1787857205.622636:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863074944 00000100:00100000:2.0:1787857205.622751:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:2.0:1787857205.622762:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+40:11566:x1874703863074944:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857205.622789:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.622811:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b43 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.622879:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.622904:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.622916:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857205.622977:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787857205.622981:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857205.623004:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.623026:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b43 expref: 42 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.623046:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b43 expref: 41 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.623054:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857205.623057:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857205.623076:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84400, rc 0) 00000100:00100000:2.0:1787857205.623254:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:11566:x1874703863074944:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 494us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.623261:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 200 00000100:00100000:2.0:1787857205.630576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.630869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075200 00000100:00100000:0.0:1787857205.630878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075200 00000100:00100000:0.0:1787857205.630949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 201 00000100:00100000:0.0:1787857205.630959:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+41:11566:x1874703863075200:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857205.630980:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857205.631000:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf586 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b4a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.631091:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf58d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.631106:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.631130:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857205.631159:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787857205.631465:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf586 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b4a expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.631493:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b4a expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.631502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:0.0:1787857205.631505:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857205.631508:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:0.0:1787857205.631624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981ee0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:11566:x1874703863075200:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 665us (1057us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787857205.631631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 201 00000100:00100000:0.0:1787857205.636122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.636691:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075328 00000100:00100000:2.0:1787857205.636703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075328 00000100:00100000:2.0:1787857205.636834:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1787857205.636846:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+43:2354:x1874703863075328:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857205.636864:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857205.636891:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf58d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b4a expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.636911:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:2.0:1787857205.636916:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857205.636984:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:2354:x1874703863075328:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 140us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.636991:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1787857205.642056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857205.642102:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075584 00000100:00100000:3.0:1787857205.642123:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075584 00000100:00100000:3.0:1787857205.642195:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:3.0:1787857205.642206:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+42:11566:x1874703863075584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857205.642238:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857205.642257:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf59b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b51 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.642360:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.642375:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.642387:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857205.642403:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787857205.642522:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf59b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b51 expref: 45 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.642540:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b51 expref: 44 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.642548:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:3.0:1787857205.642552:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787857205.642568:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:3.0:1787857205.642622:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+44:11566:x1874703863075584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 418us (587us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787857205.642629:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 202 00000100:00100000:3.0:1787857205.656562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.657638:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075712 00000100:00100000:1.0:1787857205.657651:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075712 00000100:00100000:1.0:1787857205.657771:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:1.0:1787857205.657782:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+6:2353:x1874703863075712:12345-192.168.204.29@tcp:1:lfs.0 00010000:00010000:1.0:1787857205.657842:0:8078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.657862:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.657872:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857205.657876:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857205.657881:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.657920:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.657936:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 6 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857205.657954:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c03c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885082880:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857205.658080:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857205.665335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.665630:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075840 00000100:00100000:2.0:1787857205.665641:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075840 00002000:00100000:2.0:1787857205.665738:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fd97b5561c0 x1874703863075840/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:606/0 lens 504/0 e 0 to 0 dl 1787857216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857205.665750:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97b5561c0 with x1874703863075840 ext(0->8) 00010000:00010000:2.0:1787857205.665759:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 7 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.665777:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 7 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857205.665802:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd97b5561c0 00000100:00100000:2.0:1787857205.665846:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1787857205.665857:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863075840:12345-192.168.204.29@tcp:4:lfs.0 00000100:00100000:2.0:1787857205.666574:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863075840:12345-192.168.204.29@tcp:4:lfs.0 Request processed in 665us (1196us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787857205.666585:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00002000:00100000:2.0:1787857205.666594:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fd97b5561c0 x1874703863075840/t4294967308(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:606/0 lens 504/448 e 0 to 0 dl 1787857216 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857205.666603:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97b5561c0 with x1874703863075840 ext(0->8) 00010000:00010000:2.0:1787857205.666611:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.666624:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857205.666631:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fd97b5561c0 00000100:00100000:1.0:1787857205.666821:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c03c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8078:1874703885082880:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857205.666847:0:8078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.670369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.672091:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863075968 00000100:00100000:1.0:1787857205.672104:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863075968 00010000:00010000:1.0:1787857205.672162:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857205.672285:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:1.0:1787857205.672296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2355:x1874703863075968:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857205.672311:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787857205.672331:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787857205.672334:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787857204 00002000:00010000:1.0:1787857205.672336:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787857205 00002000:00010000:1.0:1787857205.672338:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787857204 00010000:00010000:1.0:1787857205.672343:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.672358:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.672383:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002314a70d/0xf326646fe3bbf571 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b3c expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.672402:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857205.672407:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857205.672413:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.672423:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.672508:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857205.672703:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2355:x1874703863075968:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 408us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857205.672711:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00010000:00010000:2.0:1787857205.677334:0:8078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677355:0:8078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677394:0:8078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677420:0:8078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677429:0:8078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677437:0:8078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857205.677442:0:8078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677451:0:8078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677474:0:8078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.677481:0:8078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084321869/0xf326646fe3bbf5b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.677924:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96de9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863075712:12345-192.168.204.29@tcp:1:lfs.0 Request processed in 20139us (21369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.677934:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:2.0:1787857205.683212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857205.683390:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863076224 00000100:00100000:3.0:1787857205.683400:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863076224 00000100:00100000:3.0:1787857205.683454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 56 00000100:00100000:3.0:1787857205.683463:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d463c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+44:11566:x1874703863076224:12345-192.168.204.29@tcp:35:lfs.0 00000004:00010000:3.0:1787857205.683535:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b51 expref: 44 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787857205.683969:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787857205.684007:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787857205.684973:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787857205.685044:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.685064:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 48 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.685073:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.685468:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 48 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.685486:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 48 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857205.685516:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874703885083008:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857205.685747:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94920c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787857205.690997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.691109:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1874703885083008:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857205.691147:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.694842:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863076352 00000100:00100000:2.0:1787857205.694857:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863076352 00010000:00010000:2.0:1787857205.694921:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 49 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857205.694957:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:2.0:1787857205.694967:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+49:2353:x1874703863076352:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857205.694984:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857205.694991:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 49 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695005:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 49 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695030:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf55c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b2e expref: 49 pid: 8856 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695052:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:2.0:1787857205.695059:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695068:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695177:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.695218:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857205.695279:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+48:2353:x1874703863076352:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 313us (4292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.695286:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00010000:00010000:1.0:1787857205.697708:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.697729:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857205.697883:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787857205.698126:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787857205.698244:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c030c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885083136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857205.698310:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857205.698355:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857205.698760:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885083136 00000100:00100000:2.0:1787857205.698769:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885083136 00000100:00100000:2.0:1787857205.698839:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787857205.698851:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874703885083136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857205.698933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874703885083136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.698940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787857205.699041:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857205.699072:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c030c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885083136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787857205.699541:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787857205.699601:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c030c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885083264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787857205.699635:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857205.699685:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787857205.699817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885083264 00000100:00100000:2.0:1787857205.699822:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885083264 00000100:00100000:2.0:1787857205.699858:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787857205.699866:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1874703885083264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787857205.700002:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1874703885083264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (366us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787857205.700008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857205.700242:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c030c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1874703885083264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787857205.700287:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787857205.700323:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700333:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700341:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700355:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857205.700359:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700366:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700382:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:1.0:1787857205.700385:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787857205.700391:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857205.700398:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf5b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857205.700563:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787857205.700723:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787857205.700735:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360029074167ns, next at 361029071564ns, rc = 0 00000001:00080000:1.0:1787857205.700741:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787857205.700773:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362000) 00010000:00010000:1.0:1787857205.700776:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787857205.700784:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf5a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b51 expref: 52 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857205.700887:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d463c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:11566:x1874703863076224:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 17424us (17684us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787857205.700895:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 56 00000020:00080000:1.0:1787857205.700900:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:1.0:1787857205.704835:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857205.705243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.705374:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863076480 00000100:00100000:2.0:1787857205.705384:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863076480 00000100:00100000:2.0:1787857205.705438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 203 00000100:00100000:2.0:1787857205.705449:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+51:11566:x1874703863076480:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857205.705473:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.705495:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf5be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b58 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.705561:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b58 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.705575:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b58 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.705613:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857205.705617:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857205.705620:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84a00, rc 0) 00000100:00100000:2.0:1787857205.705717:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:11566:x1874703863076480:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 269us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.705724:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 203 00000100:00100000:0.0:1787857205.712472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857205.712587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863076736 00000100:00100000:1.0:1787857205.712597:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863076736 00000100:00100000:2.0:1787857205.712811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:2.0:1787857205.712825:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+52:11566:x1874703863076736:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857205.713124:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:11566:x1874703863076736:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 302us (662us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787857205.713133:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 57 00000100:00100000:3.0:1787857205.793318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.793436:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863076864 00000100:00100000:0.0:1787857205.793447:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863076864 00000100:00100000:0.0:1787857205.793510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:0.0:1787857205.793528:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:11576:x1874703863076864:12345-192.168.204.29@tcp:34:lfs.0 00010000:00010000:0.0:1787857205.793609:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793645:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793694:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793714:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793721:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793729:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793840:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793848:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793855:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857205.793901:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793914:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793920:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793935:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793941:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.793945:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793952:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.793965:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857205.794206:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.794213:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794220:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf5c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794236:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794243:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794249:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794254:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.794257:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794273:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794282:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447400) 00010000:00010000:0.0:1787857205.794284:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.794287:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794293:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794308:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794314:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794319:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794325:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.794328:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794334:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794341:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:0.0:1787857205.794343:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857205.794345:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.794361:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857205.794511:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:11576:x1874703863076864:12345-192.168.204.29@tcp:34:lfs.0 Request processed in 991us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857205.794520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 204 00000100:00100000:3.0:1787857205.838310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.838430:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863077120 00000100:00100000:2.0:1787857205.838442:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863077120 00000100:00100000:2.0:1787857205.838506:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:2.0:1787857205.838518:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+53:11579:x1874703863077120:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857205.838540:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.838561:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf5da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b5f expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838634:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838649:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838693:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838722:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838729:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838735:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838865:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838874:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.838881:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857205.838890:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787857205.839060:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839067:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839074:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839081:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857205.839085:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839101:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839125:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857205.839127:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857205.839132:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839137:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf5e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839151:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839156:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839162:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839167:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857205.839170:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839176:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839183:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362900) 00010000:00010000:2.0:1787857205.839186:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857205.839188:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839203:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf5e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839244:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf5da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b5f expref: 56 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839256:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b5f expref: 55 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.839264:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857205.839266:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857205.839268:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84600, rc 0) 00000100:00100000:2.0:1787857205.839339:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:11579:x1874703863077120:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 823us (1042us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787857205.839347:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 205 00000100:00100000:1.0:1787857205.842268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857205.842373:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863077248 00000100:00100000:0.0:1787857205.842383:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863077248 00000100:00100000:0.0:1787857205.842449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:0.0:1787857205.842459:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:11579:x1874703863077248:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:0.0:1787857205.842525:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842541:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842552:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842577:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842583:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842589:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842595:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857205.842600:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842620:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842632:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:0.0:1787857205.842635:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857205.842640:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857205.842646:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf5fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857205.842763:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:11579:x1874703863077248:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 304us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857205.842771:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 206 00000100:00100000:0.0:1787857205.848140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.848234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863077504 00000100:00100000:2.0:1787857205.848244:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863077504 00000100:00100000:2.0:1787857205.848310:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:2.0:1787857205.848322:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+55:11579:x1874703863077504:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857205.848596:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:11579:x1874703863077504:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 276us (468us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787857205.848605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 58 00000100:00100000:3.0:1787857205.966878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.966985:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863077760 00000100:00100000:2.0:1787857205.966997:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863077760 00000100:00100000:2.0:1787857205.967065:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:2.0:1787857205.967075:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+56:11589:x1874703863077760:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857205.967128:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.967132:0:8856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787857205.967162:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf57f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b43 expref: 56 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967183:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857205.967189:0:8856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857205.967204:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf604 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b66 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967308:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf60b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967322:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967332:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857205.967343:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787857205.967476:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf604 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b66 expref: 58 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967491:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf60b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b66 expref: 57 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.967498:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857205.967500:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857205.967503:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84200, rc 0) 00000100:00100000:2.0:1787857205.967577:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:11589:x1874703863077760:12345-192.168.204.29@tcp:101:bash.0 Request processed in 502us (708us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787857205.967584:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 207 00000100:00100000:0.0:1787857205.971841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857205.972137:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078016 00000100:00100000:3.0:1787857205.972149:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078016 00000100:00100000:3.0:1787857205.973032:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 208 00000100:00100000:3.0:1787857205.973048:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:11589:x1874703863078016:12345-192.168.204.29@tcp:36:bash.0 00010000:00010000:3.0:1787857205.973148:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787857205.973178:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbf60b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b66 expref: 57 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.973202:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbf5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b5f expref: 56 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.973211:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857205.973216:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857205.973451:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.973467:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.973602:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857205.973772:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787857205.973802:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c1f5b57 reply state 0000000039423eea transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857205.973810:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857205.973906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b557840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+58:11589:x1874703863078016:12345-192.168.204.29@tcp:36:bash.0 Request processed in 863us (2078us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787857205.973914:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 208 00000020:00080000:0.0:1787857205.973919:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787857205.976615:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976632:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976639:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976731:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857205.976736:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976743:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976761:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857205.976764:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857205.976769:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857205.976786:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf619 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857205.978304:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.978476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078144 00000100:00100000:2.0:1787857205.978498:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078144 00000100:00100000:2.0:1787857205.978572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:2.0:1787857205.978584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+57:11589:x1874703863078144:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857205.978607:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857205.978627:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b6d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978728:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978743:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978754:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857205.978787:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787857205.978791:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857205.978814:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978840:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978858:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857205.978881:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857205.978884:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857205.978887:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84400, rc 0) 00000100:00100000:2.0:1787857205.978953:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+58:11589:x1874703863078144:12345-192.168.204.29@tcp:101:bash.0 Request processed in 372us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857205.978961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 209 00000100:00100000:0.0:1787857205.981387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857205.981473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078400 00000100:00100000:2.0:1787857205.981492:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078400 00000100:00100000:2.0:1787857205.981552:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:2.0:1787857205.981562:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+58:11589:x1874703863078400:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:2.0:1787857205.981831:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+59:11589:x1874703863078400:12345-192.168.204.29@tcp:35:bash.0 Request processed in 269us (451us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787857205.981839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 59 00000100:00100000:0.0:1787857206.051571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.051883:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078528 00000100:00100000:3.0:1787857206.051893:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078528 00000100:00100000:3.0:1787857206.051960:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:3.0:1787857206.051972:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+59:11595:x1874703863078528:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857206.052008:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857206.052028:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b74 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052088:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052103:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052128:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.052183:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787857206.052186:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857206.052207:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052231:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b74 expref: 61 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052249:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b74 expref: 60 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.052258:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857206.052261:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857206.052264:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216dc00, rc 0) 00000100:00100000:3.0:1787857206.052557:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863078528:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 587us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.052564:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 210 00000100:00100000:0.0:1787857206.057940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.058058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078656 00000100:00100000:2.0:1787857206.058067:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078656 00000100:00100000:2.0:1787857206.058220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:2.0:1787857206.058232:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863078656:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857206.058254:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857206.058275:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf63c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b7b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058340:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058355:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058375:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058389:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058396:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058403:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058538:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058546:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058553:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857206.058587:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787857206.058592:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857206.058609:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058620:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058628:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058644:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058650:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058695:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857206.058699:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058707:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058719:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857206.058722:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857206.058727:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058734:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058749:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058755:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058760:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058765:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857206.058773:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058779:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058788:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd949362900) 00010000:00010000:2.0:1787857206.058790:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857206.058793:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058798:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf64a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058828:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf63c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b7b expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058842:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b7b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.058849:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857206.058851:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857206.058853:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857206.058915:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11595:x1874703863078656:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 686us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.058923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 211 00000100:00100000:1.0:1787857206.063208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.063337:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863078784 00000100:00100000:3.0:1787857206.063347:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863078784 00000100:00100000:3.0:1787857206.063414:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1787857206.063432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:2352:x1874703863078784:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787857206.063448:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857206.063474:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbf651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b7b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.063505:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.063511:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857206.063568:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:2352:x1874703863078784:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.063576:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:3.0:1787857206.064811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.064900:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079040 00000100:00100000:0.0:1787857206.064907:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079040 00000100:00100000:0.0:1787857206.064959:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:0.0:1787857206.064969:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863079040:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857206.064994:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857206.065018:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b82 expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.065139:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.065155:0:8856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.065163:0:8856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.065196:0:8856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.065217:0:8856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 61 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.065230:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ead00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885083392:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857206.065306:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857206.068219:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ead00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8856:1874703885083392:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857206.068244:0:8856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.069533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.069707:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079168 00000100:00100000:0.0:1787857206.069716:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079168 00010000:00010000:0.0:1787857206.069753:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 62 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.069781:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:0.0:1787857206.069789:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:2352:x1874703863079168:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857206.069800:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.069805:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 62 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069814:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 62 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069832:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbf627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b6d expref: 62 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069843:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:0.0:1787857206.069847:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069854:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069859:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.069881:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857206.069933:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:2352:x1874703863079168:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 145us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.069939:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00010000:00010000:3.0:1787857206.069950:0:8856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.069961:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.070049:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787857206.070310:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 62 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.070337:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 61 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.070346:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.070362:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787857206.070365:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975561a00, rc 0) 00000100:00100000:3.0:1787857206.070401:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11595:x1874703863079040:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 5434us (5596us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787857206.070408:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 212 00000100:00100000:3.0:1787857206.072975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.073486:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079424 00000100:00100000:0.0:1787857206.073494:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079424 00000100:00100000:0.0:1787857206.073617:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:0.0:1787857206.073628:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11595:x1874703863079424:12345-192.168.204.29@tcp:103:lfs.0 00010000:00010000:0.0:1787857206.073645:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.073830:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84a00/0xf326646fe3bbf5be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b58 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.073852:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:0.0:1787857206.073857:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857206.073913:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863079424:12345-192.168.204.29@tcp:103:lfs.0 Request processed in 287us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.073921:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1787857206.078675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.078837:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079552 00000100:00100000:3.0:1787857206.078848:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079552 00000100:00100000:3.0:1787857206.078956:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:3.0:1787857206.078967:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863079552:12345-192.168.204.29@tcp:58:lfs.0 00010000:00010000:3.0:1787857206.079089:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.079114:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.079126:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857206.079333:0:8075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787857206.079428:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863079552:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 462us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.079435:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 213 00000100:00100000:1.0:1787857206.087587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.088977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079680 00000100:00100000:3.0:1787857206.089001:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079680 00000100:00100000:3.0:1787857206.089329:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 214 00000100:00100000:3.0:1787857206.089340:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+60:11595:x1874703863079680:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857206.089366:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857206.089415:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b89 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089489:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089499:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089517:0:5836:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089530:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089545:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.089548:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857206.089551:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.089558:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd98216de00, rc 0) 00000100:00100000:3.0:1787857206.089815:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b536940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11595:x1874703863079680:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 475us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.089822:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 214 00000040:00080000:2.0:1787857206.473826:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857206.473836:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857206.474017:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787857206.474024:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857206.474179:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885083520:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857206.474375:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787857206.487051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.487143:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079808 00000100:00100000:3.0:1787857206.487152:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079808 00000100:00100000:3.0:1787857206.487221:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:3.0:1787857206.487232:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863079808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857206.487265:0:8856:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857206.487422:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863079808:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 191us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.487431:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 215 00000100:00100000:2.0:1787857206.494075:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885083520:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857206.495768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.495944:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863079936 00000100:00100000:3.0:1787857206.495953:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863079936 00000100:00100000:3.0:1787857206.496026:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:3.0:1787857206.496036:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11596:x1874703863079936:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.496131:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496150:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496161:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496177:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496184:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496191:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496214:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496221:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496227:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.496304:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787857206.496308:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857206.496322:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496333:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496341:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496348:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496355:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.496359:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496366:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496379:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:3.0:1787857206.496382:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.496387:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496393:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216ca00/0xf326646fe3bbf67b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496417:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496435:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496440:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496444:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.496448:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496454:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496463:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fd946159200) 00010000:00010000:3.0:1787857206.496466:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.496469:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496475:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045e00/0xf326646fe3bbf682 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496490:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496496:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496502:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496508:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.496516:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496523:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496530:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.496533:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.496536:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.496542:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045200/0xf326646fe3bbf689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.496618:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11596:x1874703863079936:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 583us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.496626:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 216 00000100:00100000:1.0:1787857206.499064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.499507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863080192 00000100:00100000:3.0:1787857206.499517:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863080192 00000100:00100000:3.0:1787857206.499580:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:3.0:1787857206.499590:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+61:11596:x1874703863080192:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.499611:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857206.499632:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf690 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b90 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.499831:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.499846:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.499876:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.499888:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787857206.499988:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.499997:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500003:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500010:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.500015:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500023:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500036:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.500039:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787857206.500045:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500051:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500093:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf690 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b90 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500127:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:3.0:1787857206.500129:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857206.500135:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044600/0xf326646fe3bbf690 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b90 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.500145:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044600, rc 0) 00000100:00100000:3.0:1787857206.500264:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080192:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 675us (1209us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787857206.500272:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 217 00000100:00100000:1.0:1787857206.513261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.517243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863080320 00000100:00100000:0.0:1787857206.517261:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863080320 00000100:00100000:0.0:1787857206.517393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:0.0:1787857206.517405:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080320:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857206.517443:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857206.517569:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9602b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080320:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 166us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.517578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 218 00000100:00100000:1.0:1787857206.529595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.529716:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863080576 00000100:00100000:2.0:1787857206.529727:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863080576 00000100:00100000:2.0:1787857206.529793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 219 00000100:00100000:2.0:1787857206.529817:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080576:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857206.529841:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857206.529844:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787857206.530176:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216dc00/0xf326646fe3bbf635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b74 expref: 62 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.530196:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:2.0:1787857206.530201:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857206.530216:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf6a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b97 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787857206.531146:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787857206.531374:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf6ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.531389:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.531401:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.531456:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbf6a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b97 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.531488:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf6ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b97 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.531497:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd949362900) 00010000:00010000:2.0:1787857206.531500:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857206.531503:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84c00, rc 0) 00000100:00100000:2.0:1787857206.531579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+63:11596:x1874703863080576:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1776us (1993us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787857206.531588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 219 00000100:00100000:1.0:1787857206.551556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.551714:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863080832 00000100:00100000:0.0:1787857206.551725:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863080832 00000100:00100000:0.0:1787857206.551820:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:0.0:1787857206.551845:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+63:11596:x1874703863080832:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857206.552273:0:8856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.552301:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbf6ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b97 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552321:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd949362900) 00010000:00010000:0.0:1787857206.552330:0:8856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857206.552351:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552367:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552377:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552397:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552405:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552412:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552487:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552495:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552513:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552519:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857206.552524:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552531:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552539:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:0.0:1787857206.552542:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857206.552546:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552552:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf6ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552562:0:8856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552568:0:8856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552574:0:8856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552578:0:8856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857206.552581:0:8856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552597:0:8856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552606:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1691e144 (ffff9fd953447400) 00010000:00010000:0.0:1787857206.552609:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787857206.552612:0:8856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.552618:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1691e144 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.552741:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080832:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 897us (1195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857206.552749:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 220 00000100:00100000:1.0:1787857206.562089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.562199:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863080960 00000100:00100000:0.0:1787857206.562211:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863080960 00000100:00100000:0.0:1787857206.562279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 221 00000100:00100000:0.0:1787857206.562289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+62:11596:x1874703863080960:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857206.562312:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857206.562337:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882b9e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.562855:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.562871:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.562881:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.562988:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.563012:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.563020:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:1.0:1787857206.563030:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857206.563034:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979200, rc 0) 00000100:00100000:1.0:1787857206.563220:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+63:11596:x1874703863080960:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 931us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857206.563228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 221 00000100:00100000:1.0:1787857206.568871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.568989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863081216 00000100:00100000:3.0:1787857206.569000:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863081216 00000100:00100000:3.0:1787857206.569048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 222 00000100:00100000:3.0:1787857206.569059:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+63:11596:x1874703863081216:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.569153:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.569173:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.569185:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857206.569545:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1787857206.569554:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360897893398ns, next at 361897891261ns, rc = 0 00000004:00010000:3.0:1787857206.569644:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055e98e69 reply state 000000006127b700 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.569946:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787857206.570112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+65:11596:x1874703863081216:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1053us (1248us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1787857206.570120:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 222 00010000:00010000:2.0:1787857206.577827:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577845:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577853:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577859:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857206.577864:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577872:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577891:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:2.0:1787857206.577894:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857206.577900:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.577924:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031400/0xf326646fe3bbf6d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.581641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.582439:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863081344 00000100:00100000:3.0:1787857206.582450:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863081344 00000100:00100000:3.0:1787857206.582517:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 223 00000100:00100000:3.0:1787857206.582527:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+64:11596:x1874703863081344:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.582551:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857206.582573:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ba5 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.582636:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 65 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.582652:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 65 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.582900:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:3.0:1787857206.582904:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857206.582909:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031e00, rc 0) 00000100:00100000:3.0:1787857206.582970:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+65:11596:x1874703863081344:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 444us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.582977:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 223 00000100:00100000:0.0:1787857206.588583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.588712:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863081472 00000100:00100000:2.0:1787857206.588725:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863081472 00000100:00100000:2.0:1787857206.588806:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:2.0:1787857206.588816:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863081472:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787857206.589113:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863081472:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 297us (539us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787857206.589122:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00080000:1.0:1787857206.589525:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857206.593201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.593340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863081728 00000100:00100000:2.0:1787857206.593351:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863081728 00000100:00100000:2.0:1787857206.593413:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:2.0:1787857206.593423:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+65:11596:x1874703863081728:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857206.593848:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+66:11596:x1874703863081728:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 426us (653us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787857206.593856:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 60 00000100:00100000:1.0:1787857206.614124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.616483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863081984 00000100:00100000:2.0:1787857206.616498:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863081984 00000100:00100000:2.0:1787857206.616574:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:2.0:1787857206.616584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+66:11596:x1874703863081984:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857206.616741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+66:11596:x1874703863081984:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 158us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.616751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 224 00000100:00100000:0.0:1787857206.619572:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.619801:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082112 00000100:00100000:3.0:1787857206.619811:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082112 00000100:00100000:3.0:1787857206.619888:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 225 00000100:00100000:3.0:1787857206.619899:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+66:11596:x1874703863082112:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.619917:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857206.619938:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf6e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bac expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620003:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620016:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620029:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.620063:0:8856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857206.620082:0:8856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620123:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf6e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bac expref: 68 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620143:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bac expref: 67 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.620152:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:3.0:1787857206.620155:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787857206.620159:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940030600, rc 0) 00000100:00100000:3.0:1787857206.621320:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+67:11596:x1874703863082112:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1419us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.621342:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 225 00000100:00100000:1.0:1787857206.628092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.628153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.628188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.628282:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082368 00000100:00100000:0.0:1787857206.628292:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082368 00000100:00100000:0.0:1787857206.628351:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1787857206.628361:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863082368:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857206.628462:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863082368:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.628470:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:3.0:1787857206.628623:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082496 00000100:00100000:3.0:1787857206.628628:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082496 00000100:00100000:3.0:1787857206.628694:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00100000:3.0:1787857206.628702:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863082496:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857206.628737:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+5:2353:x1874703863082496:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.628745:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 144 00000100:00080000:0.0:1787857206.628797:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857206.631212:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082240 00000100:00100000:2.0:1787857206.631226:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082240 00000100:00100000:2.0:1787857206.631293:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 291 00000100:00100000:2.0:1787857206.631303:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863082240:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857206.631391:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958405c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863082240:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 89us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.631398:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 291 00000100:00100000:0.0:1787857206.636592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.637015:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082624 00000100:00100000:2.0:1787857206.637025:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082624 00000100:00100000:2.0:1787857206.637086:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:2.0:1787857206.637106:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+10:2352:x1874703863082624:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857206.637127:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857206.637148:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bb3 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857206.637175:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908936, blocks: 0x1 00010000:00010000:2.0:1787857206.637193:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787857206.637198:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857206.637208:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.637225:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.637238:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84e00, rc 0) 00000100:00100000:2.0:1787857206.637302:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:2352:x1874703863082624:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 208us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.637323:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:3.0:1787857206.640744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.640864:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863082880 00000100:00100000:0.0:1787857206.640874:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863082880 00000100:00100000:0.0:1787857206.640934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:0.0:1787857206.640944:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+67:11596:x1874703863082880:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787857206.641060:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+67:11596:x1874703863082880:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.641068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 226 00000100:00100000:1.0:1787857206.647904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.648006:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083008 00000100:00100000:0.0:1787857206.648016:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083008 00000100:00100000:0.0:1787857206.648080:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:0.0:1787857206.648090:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+11:11596:x1874703863083008:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857206.648120:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857206.648142:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bba expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.648180:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.648190:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857206.648194:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857206.648200:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.648245:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.648259:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.648274:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885083648:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857206.648838:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857206.651305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.651588:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874703885083648:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857206.651624:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.651647:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560c00, rc 0) 00000100:00100000:0.0:1787857206.651787:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:11596:x1874703863083008:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 3698us (3893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.651799:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1787857206.657992:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083136 00000100:00100000:2.0:1787857206.658007:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083136 00010000:00010000:2.0:1787857206.658052:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.658109:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:2.0:1787857206.658119:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:2352:x1874703863083136:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857206.658134:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857206.658157:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.658173:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.658198:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e7bb21a/0xf326646fe3bbf6f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bb3 expref: 12 pid: 6678 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.658216:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857206.658220:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857206.658228:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.658238:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.658294:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.658309:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885083776:192.168.204.29@tcp:105: 00000100:00100000:2.0:1787857206.658405:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857206.661996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.663815:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083264 00000100:00100000:3.0:1787857206.663829:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083264 00002000:00100000:3.0:1787857206.663883:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fd97bb48780 x1874703863083264/t0(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:607/0 lens 504/0 e 0 to 0 dl 1787857217 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857206.663894:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97bb48780 with x1874703863083264 ext(0->12) 00002000:00010000:3.0:1787857206.663899:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd97bb48780 00000100:00100000:3.0:1787857206.663927:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1787857206.663936:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+12:2353:x1874703863083264:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787857206.672916:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2353:x1874703863083264:12345-192.168.204.29@tcp:4:lhsmtool_posix.0 Request processed in 8968us (10918us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787857206.672932:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00002000:00100000:3.0:1787857206.672947:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fd97bb48780 x1874703863083264/t4294967320(0) o4->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:607/0 lens 504/448 e 0 to 0 dl 1787857217 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787857206.672957:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97bb48780 with x1874703863083264 ext(0->12) 00002000:00010000:3.0:1787857206.672981:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd97bb48780 00000100:00100000:2.0:1787857206.682374:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5822:1874703885083776:192.168.204.29@tcp:105: 00010000:00010000:2.0:1787857206.682412:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857206.682608:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:2352:x1874703863083136:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 24489us (31310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.682619:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:1.0:1787857206.684986:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.685060:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083392 00000100:00100000:3.0:1787857206.685073:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083392 00000100:00100000:3.0:1787857206.685148:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 227 00000100:00100000:3.0:1787857206.685160:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+67:11596:x1874703863083392:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787857206.718878:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:2.0:1787857206.718899:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787857206.718937:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787857206.718952:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd9612aac00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787857206.718957:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd9612aad80 00000020:00080000:2.0:1787857206.718960:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97fdee400 00000020:00080000:2.0:1787857206.718980:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd9612aa480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787857206.718983:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd9612aa6c0 00000020:00080000:2.0:1787857206.718986:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd97b522800 00000001:00080000:2.0:1787857206.718996:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787857206.719016:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787857206.719220:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787857206.719385:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787857206.719431:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885083904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787857206.719830:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97fde4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885084032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857206.719889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857206.719942:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857206.719949:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885084160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787857206.719972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857206.720080:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11596:x1874703863083392:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 34921us (35101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857206.720090:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 227 00000100:00100000:2.0:1787857206.720224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857206.720270:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885084032 00000100:00100000:2.0:1787857206.720277:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885084032 00000100:00100000:2.0:1787857206.720321:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885084160 00000100:00100000:2.0:1787857206.720324:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885084160 00000100:00100000:2.0:1787857206.720335:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885083904 00000100:00100000:2.0:1787857206.720337:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885083904 00000100:00100000:2.0:1787857206.720349:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857206.720357:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885084032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787857206.720775:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787857206.720779:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787857206 00002000:00010000:2.0:1787857206.720782:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787857206.720784:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787857206 -> 1787857206 00002000:00010000:2.0:1787857206.720787:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787857206.720827:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874703885084032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 470us (937us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787857206.720834:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857206.720850:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787857206.720856:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885084160:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787857206.720871:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787857206.720897:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a908934, atime: 0x6a908935, ctime: 0x6a908934, blocks: 0x1 00010000:00010000:2.0:1787857206.720904:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.720920:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1787857206.720924:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857206.720931:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.720959:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.720968:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.720975:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.720992:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857206.721521:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857206.721531:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885083904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787857206.721555:0:8078:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1787857206.721569:0:8078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.721585:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.721593:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787857206.721596:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857206.721600:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.721630:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.721645:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 12 pid: 6676 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.721677:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885084288:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857206.721729:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857206.723613:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874703885084160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 544us (1426us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787857206.723628:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787857206.723891:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857206.723901:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.723912:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857206.723916:0:11155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.723949:0:11155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.723972:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.723981:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf700 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.724007:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857206.724009:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857206.724010:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787857206.724025:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787857206.724070:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd96d8b5680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787857206.724077:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885084160:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787857206.724090:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd97fde4780/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787857206.724106:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97fde4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885084032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787857206.726223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.726309:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083520 00000100:00100000:2.0:1787857206.726318:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083520 00000100:00100000:2.0:1787857206.726383:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:2.0:1787857206.726394:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+13:2352:x1874703863083520:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787857206.727053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.727290:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083648 00000100:00100000:0.0:1787857206.727295:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083648 00010000:00010000:0.0:1787857206.727322:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 14 pid: 6676 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.727354:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:0.0:1787857206.727361:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2353:x1874703863083648:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857206.727402:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.727408:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 14 pid: 6676 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.727423:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 14 pid: 6676 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.727450:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857206.727454:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857206.727460:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.727631:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.727653:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857206.728325:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+14:2353:x1874703863083648:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 962us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.728333:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00010000:00010000:2.0:1787857206.729288:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857206.730770:0:8078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf4c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b19 expref: 13 pid: 6676 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.730793:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885084288:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857206.730827:0:8078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.730838:0:8078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.730844:0:8078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.730855:0:8078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.730864:0:8078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.730880:0:8078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787857206.731818:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874703885083904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10286us (11590us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787857206.731830:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787857206.734191:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857206.734206:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.734219:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857206.734224:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.734234:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.734255:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.734263:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054ea51da/0xf326646fe3bbf707 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.734284:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857206.734286:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857206.734288:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857206.735413:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd975484000/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787857206.735427:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd975484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885083904:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787857206.776143:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1787857206.776176:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1787857206.776187:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1787857206.776382:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863083520:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 49984us (50160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.776393:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:3.0:1787857206.779202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.779348:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863083904 00000100:00100000:2.0:1787857206.779367:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863083904 00000100:00100000:2.0:1787857206.779428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:2.0:1787857206.779438:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11596:x1874703863083904:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787857206.779497:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857206.779532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030600/0xf326646fe3bbf6eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bac expref: 21 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.779552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:2.0:1787857206.779558:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857206.779585:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.779598:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.779608:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857206.780568:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a98983e0 reply state 000000008c5beed4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.780582:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857206.780972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:11596:x1874703863083904:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 1532us (1776us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787857206.780980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 228 00000100:00100000:3.0:1787857206.783508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00010000:00010000:1.0:1787857206.783611:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783624:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783632:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783656:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857206.783675:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783684:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783702:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:1.0:1787857206.783705:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857206.783709:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.783716:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85200/0xf326646fe3bbf70e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.784199:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084032 00000100:00100000:2.0:1787857206.784208:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084032 00000100:00100000:2.0:1787857206.784350:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1787857206.784360:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2353:x1874703863084032:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787857206.784579:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787857206.784583:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787857206 -> 1787857205 00002000:00010000:2.0:1787857206.784586:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787857205 00002000:00010000:2.0:1787857206.784589:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787857206 -> 1787857205 00002000:00010000:2.0:1787857206.784591:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787857206.784651:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2353:x1874703863084032:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 292us (1150us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787857206.784677:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:3.0:1787857206.786380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857206.786709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084288 00000100:00100000:3.0:1787857206.786717:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084288 00000100:00100000:3.0:1787857206.786764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:3.0:1787857206.786773:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:11596:x1874703863084288:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787857206.786835:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.786851:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.786861:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.786892:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.786907:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 21 pid: 5837 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.786921:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885084416:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857206.786987:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857206.789567:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885084416:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857206.789595:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.790596:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.790877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084416 00000100:00100000:2.0:1787857206.790886:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084416 00010000:00010000:2.0:1787857206.790922:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 22 pid: 5837 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.790957:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1787857206.790967:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:2353:x1874703863084416:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857206.790981:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857206.790988:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 22 pid: 5837 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791001:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 22 pid: 5837 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791023:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979200/0xf326646fe3bbf6cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b9e expref: 22 pid: 5837 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791037:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:2.0:1787857206.791051:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791061:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791069:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.791104:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857206.791158:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:2353:x1874703863084416:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 192us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.791166:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00010000:00010000:0.0:1787857206.791560:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791569:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791596:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791614:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791621:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791627:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857206.791631:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791639:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791649:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:0.0:1787857206.791652:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787857206.791656:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.791694:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031a00/0xf326646fe3bbf715 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.791747:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11596:x1874703863084288:12345-192.168.204.29@tcp:55:lhsmtool_posix.0 Request processed in 4974us (5373us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787857206.791756:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 229 00000100:00100000:3.0:1787857206.795289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.795563:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084544 00000100:00100000:1.0:1787857206.795573:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084544 00000100:00100000:1.0:1787857206.795695:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:1.0:1787857206.795706:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863084544:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787857206.795751:0:8078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.795771:0:8078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.795781:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787857206.795785:0:8078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787857206.795790:0:8078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.795838:0:8078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.795852:0:8078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 8 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.795867:0:8078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885084544:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857206.795942:0:8078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857206.798554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.798653:0:8078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8078:1874703885084544:192.168.204.29@tcp:104: 00010000:00010000:1.0:1787857206.798695:0:8078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.799864:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084672 00000100:00100000:0.0:1787857206.799874:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084672 00010000:00010000:0.0:1787857206.799919:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 9 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.799991:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:0.0:1787857206.800016:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+9:2352:x1874703863084672:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857206.800031:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.800053:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 9 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.800066:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 9 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.800102:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd56fbf/0xf326646fe3bbf6f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bba expref: 9 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.800118:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857206.800122:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857206.800128:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.800138:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.800169:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857206.800225:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863084672:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 210us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.800233:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00010000:00010000:1.0:1787857206.801173:0:8078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801186:0:8078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801213:0:8078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801222:0:8078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801257:0:8078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801265:0:8078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857206.801270:0:8078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801278:0:8078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801292:0:8078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.801307:0:8078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001684e5bb/0xf326646fe3bbf71c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.801378:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863084544:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 5672us (6099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857206.801386:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 70 00000100:00100000:3.0:1787857206.803636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.803876:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863084928 00000100:00100000:1.0:1787857206.803885:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863084928 00000100:00100000:1.0:1787857206.803941:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 230 00000100:00100000:1.0:1787857206.803950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11596:x1874703863084928:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787857206.804021:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804049:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804061:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804473:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804485:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 21 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804494:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804524:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 21 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.804537:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 21 pid: 8075 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857206.804551:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885084672:192.168.204.29@tcp:104: 00000100:00100000:1.0:1787857206.804732:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857206.811312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.811598:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885084672:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857206.811624:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.814350:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863085056 00000100:00100000:2.0:1787857206.814364:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863085056 00010000:00010000:2.0:1787857206.814423:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 22 pid: 8075 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857206.814479:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:2.0:1787857206.814489:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:2353:x1874703863085056:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857206.814504:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857206.814511:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 22 pid: 8075 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814525:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 22 pid: 8075 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814549:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031e00/0xf326646fe3bbf6dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ba5 expref: 22 pid: 8075 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814580:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:2.0:1787857206.814586:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814595:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814603:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857206.814631:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857206.814709:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:2353:x1874703863085056:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 222us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.814717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00010000:00010000:1.0:1787857206.815725:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857206.815738:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787857206.815948:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787857206.816102:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787857206.816148:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787857206.816235:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885084800:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857206.817517:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857206.817566:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857206.817642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885084800 00000100:00100000:0.0:1787857206.817650:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885084800 00000100:00100000:0.0:1787857206.817714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787857206.817722:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874703885084800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787857206.817806:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874703885084800:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.817813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857206.817891:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787857206.817897:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1787857206.817913:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd97fde4780, transno 4294967321 00000100:00100000:1.0:1787857206.818123:0:5836:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fd975484000 x1874703885083904/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787857222 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857206.818136:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885084800:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787857206.818737:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787857206.818818:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885084928:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857206.818857:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857206.818875:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857206.819213:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885084928 00000100:00100000:3.0:1787857206.819218:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885084928 00000100:00100000:3.0:1787857206.819260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787857206.819268:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874703885084928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787857206.819484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1874703885084928:12345-0@lo:1000:mdt00_000.0 Request processed in 217us (626us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787857206.819492:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787857206.819529:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1874703885084928:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787857206.819562:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819573:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819581:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819588:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.819592:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819599:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819626:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd953447400) 00010000:00010000:3.0:1787857206.819629:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857206.819634:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819641:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf72a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819702:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819709:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819714:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819718:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.819721:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819727:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819735:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.819738:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857206.819745:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819756:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819772:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.819798:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.819809:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885085056:192.168.204.29@tcp:105: 00000100:00100000:3.0:1787857206.819869:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddd3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857206.826987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.827061:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863085184 00000100:00100000:2.0:1787857206.827071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863085184 00000100:00100000:2.0:1787857206.827142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:2.0:1787857206.827152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11595:x1874703863085184:12345-192.168.204.29@tcp:49:lfs.0 00000100:00100000:2.0:1787857206.827287:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+25:11595:x1874703863085184:12345-192.168.204.29@tcp:49:lfs.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.827294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 61 00000100:00100000:3.0:1787857206.829003:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb59a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1874703885085056:192.168.204.29@tcp:105: 00010000:00010000:3.0:1787857206.829028:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829039:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216d600/0xf326646fe3bbf66d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829072:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829087:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829107:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829117:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829123:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829145:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829151:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.829156:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829163:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829175:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.829178:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.829181:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829186:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf731 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829197:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829203:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829208:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829212:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.829215:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829229:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829238:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.829240:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787857206.829252:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.829259:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.829453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11596:x1874703863084928:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 25503us (25822us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787857206.830561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 230 00000020:00080000:3.0:1787857206.830568:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787857206.832987:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857206.832996:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857206.833533:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787857206.833541:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787857206.845625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857206.845717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.845807:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863085440 00000100:00100000:2.0:1787857206.845817:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863085440 00000100:00100000:2.0:1787857206.845883:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 231 00000100:00100000:2.0:1787857206.845892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11595:x1874703863085440:12345-192.168.204.29@tcp:58:lfs.0 00000040:00080000:2.0:1787857206.846261:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787857206.846337:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11595:x1874703863085440:12345-192.168.204.29@tcp:58:lfs.0 Request processed in 445us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857206.846345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 231 00000100:00100000:3.0:1787857206.846639:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863085696 00000100:00100000:3.0:1787857206.846645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863085696 00000100:00100000:3.0:1787857206.846711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 62 00000100:00100000:3.0:1787857206.846718:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d463850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+24:11596:x1874703863085696:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787857206.847202:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787857206.847288:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787857206.847326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847342:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847353:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847371:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847378:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847385:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.847787:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787857206.847871:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d463850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:11596:x1874703863085696:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1150us (2150us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787857206.847878:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 62 00000020:00080000:3.0:1787857206.847883:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787857206.848436:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857206.848446:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.848454:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857206.848467:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.848477:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.848492:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fd946159200) 00010000:00010000:0.0:1787857206.848496:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787857206.848500:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.848506:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030200/0xf326646fe3bbf738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.848540:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857206.848542:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857206.848544:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857206.909322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.909452:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863085824 00000100:00100000:0.0:1787857206.909472:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863085824 00000100:00100000:0.0:1787857206.909544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 232 00000100:00100000:0.0:1787857206.909555:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+26:11598:x1874703863085824:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857206.909580:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857206.909601:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf73f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bc1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909715:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909733:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909745:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909759:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909766:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.909772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.910078:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.910102:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 27 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.910125:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.910164:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 27 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.910179:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 27 pid: 8856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.910193:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885085184:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857206.910293:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857206.914796:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1874703885085184:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857206.914830:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857206.919000:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857206.919340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086080 00000100:00100000:2.0:1787857206.919361:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086080 00000100:00100000:2.0:1787857206.919426:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:2.0:1787857206.919437:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:5592:x1874703863086080:12345-192.168.204.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787857206.921624:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:5592:x1874703863086080:12345-192.168.204.29@tcp:35:ldlm_bl.0 Request processed in 2177us (2623us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787857206.921637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 63 00000100:00100000:1.0:1787857206.925302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857206.925891:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086208 00000100:00100000:0.0:1787857206.925902:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086208 00010000:00010000:0.0:1787857206.925944:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 29 pid: 8856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857206.926034:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1787857206.926045:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:2353:x1874703863086208:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857206.926060:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857206.926066:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 29 pid: 8856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926108:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 29 pid: 8856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926133:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561a00/0xf326646fe3bbf65f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b82 expref: 29 pid: 8856 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926150:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:0.0:1787857206.926156:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926176:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926184:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857206.926217:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857206.926279:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:2353:x1874703863086208:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 235us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857206.926286:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00010000:00010000:3.0:1787857206.926354:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926363:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857206.926412:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787857206.926417:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857206.926437:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926449:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926467:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926480:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926487:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926492:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560000 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.926497:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.926504:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928371:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:3.0:1787857206.928379:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.928386:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928402:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560000/0xf326646fe3bbf746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928420:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928426:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928432:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928437:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857206.928461:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928468:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928476:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fd953447900) 00010000:00010000:3.0:1787857206.928479:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857206.928482:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928488:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560a00/0xf326646fe3bbf74d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928542:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560c00/0xf326646fe3bbf73f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928555:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc1 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857206.928562:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857206.928564:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787857206.928567:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560600, rc 0) 00000100:00100000:3.0:1787857206.929138:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11598:x1874703863085824:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 19582us (19824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857206.929147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 232 00010000:00010000:1.0:1787857207.753470:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857207.845577:0:12448:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857207.845588:0:12448:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857207.845989:0:12448:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787857207.845996:0:12448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787857207.880101:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857207.880113:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857207.880177:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787857207.880184:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857207.880322:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885085312:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787857207.880443:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01900 going to sleep for 11 seconds 00000100:00100000:1.0:1787857207.895698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857207.895848:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842dce1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874703885085312:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787857207.895914:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086336 00000100:00100000:3.0:1787857207.895923:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086336 00000100:00100000:3.0:1787857207.896018:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 233 00000100:00100000:3.0:1787857207.896030:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11609:x1874703863086336:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857207.896097:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857207.896212:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11609:x1874703863086336:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 183us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857207.896220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 233 00000100:00080000:1.0:1787857207.896391:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857207.918035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857207.918368:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086592 00000100:00100000:2.0:1787857207.918520:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086592 00000100:00100000:2.0:1787857207.918626:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 234 00000100:00100000:2.0:1787857207.918637:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+27:11609:x1874703863086592:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857207.919291:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857207.919325:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf75b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bc8 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.919568:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.919584:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.919599:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857207.919612:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787857207.920237:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84000/0xf326646fe3bbf75b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc8 expref: 30 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.920259:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc8 expref: 29 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.920267:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857207.920270:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857207.920274:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85600, rc 0) 00000100:00100000:2.0:1787857207.920363:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11609:x1874703863086592:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1728us (2340us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787857207.920373:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 234 00000100:00100000:2.0:1787857207.936965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857207.937028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857207.937059:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086720 00000100:00100000:2.0:1787857207.937084:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086720 00000100:00100000:2.0:1787857207.937164:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1787857207.937173:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:2353:x1874703863086720:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857207.937203:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857207.937231:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85600/0xf326646fe3bbf762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc8 expref: 29 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937250:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857207.937255:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857207.937302:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:2353:x1874703863086720:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 130us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857207.937309:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1787857207.937334:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863086976 00000100:00100000:2.0:1787857207.937337:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863086976 00000100:00100000:2.0:1787857207.937359:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 235 00000100:00100000:2.0:1787857207.937365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+28:11609:x1874703863086976:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787857207.937503:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937517:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937526:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937936:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937949:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937956:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937962:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857207.937966:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937973:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937983:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:2.0:1787857207.937986:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857207.937989:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857207.937995:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85a00/0xf326646fe3bbf770 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857207.938126:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11609:x1874703863086976:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 758us (1095us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787857207.938134:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 235 00000040:00080000:2.0:1787857207.938920:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857207.938925:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857207.939984:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787857207.939994:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857207.943374:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857207.943520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863087232 00000100:00100000:2.0:1787857207.943531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863087232 00000100:00100000:2.0:1787857207.943631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:2.0:1787857207.943643:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+29:11609:x1874703863087232:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857207.944031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11609:x1874703863087232:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 390us (666us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787857207.944040:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 64 00000100:00100000:0.0:1787857208.136039:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885085696:0@lo:400:kworker.0 00000100:00100000:0.0:1787857208.136127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857208.136196:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857208.136213:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885085824:0@lo:400:kworker.0 00000100:00100000:0.0:1787857208.136241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857208.136278:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885085696 00000100:00100000:0.0:1787857208.136299:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885085696 00000100:00100000:0.0:1787857208.136357:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787857208.136368:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885085696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857208.136558:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885085696:12345-0@lo:400:kworker.0 Request processed in 192us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857208.136566:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787857208.136592:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885085824 00000100:00100000:0.0:1787857208.136596:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885085824 00000100:00100000:2.0:1787857208.136720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885085568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.136751:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857208.136770:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885086080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.136791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857208.136879:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885085440:0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.136915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857208.136948:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885085952:0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.136983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857208.137015:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885085440 00000100:00100000:1.0:1787857208.137019:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885085440 00000100:00100000:1.0:1787857208.137048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787857208.137055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.137102:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885085440:12345-0@lo:400:kworker.0 Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857208.137109:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787857208.137151:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885085440:0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.139818:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885085568 00000100:00100000:1.0:1787857208.139843:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885085568 00000100:00100000:1.0:1787857208.139911:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885085952 00000100:00100000:1.0:1787857208.139915:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885085952 00000100:00100000:1.0:1787857208.139952:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787857208.139962:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.140049:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885085568:12345-0@lo:400:kworker.0 Request processed in 88us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857208.140056:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787857208.140091:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787857208.140098:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885085952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857208.140134:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885085952:12345-0@lo:400:kworker.0 Request processed in 37us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857208.140140:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787857208.140155:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857208.140160:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857208.140191:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885085952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.141030:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885085568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.141100:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857208.141141:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857208.141173:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885085696:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.141216:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086208 00000100:00100000:2.0:1787857208.141220:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086208 00000100:00100000:2.0:1787857208.141257:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857208.141265:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885086208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857208.141296:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857208.141334:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885086208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857208.141341:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787857208.141613:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857208.145499:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086080 00000100:00100000:0.0:1787857208.145515:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086080 00000100:00100000:0.0:1787857208.145590:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787857208.145601:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874703885085824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857208.145721:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1874703885085824:12345-0@lo:400:kworker.0 Request processed in 122us (9477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857208.145728:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787857208.145748:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787857208.145755:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857208.145805:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885086080:12345-0@lo:400:kworker.0 Request processed in 50us (9013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857208.145811:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787857208.149007:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787857208.149132:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885086080:0@lo:400:kworker.0 00000100:00100000:2.0:1787857208.149242:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885085824:0@lo:400:kworker.0 00000001:00080000:3.0:1787857208.206011:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1787857208.206030:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1787857208.776762:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857209.160873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857209.160898:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857209.160962:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857209.161091:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086336 00000100:00100000:1.0:1787857209.161100:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086336 00000100:00100000:1.0:1787857209.161154:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787857209.161164:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885086336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857209.161198:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857209.161260:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885086336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857209.161268:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787857209.161539:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787857209.161546:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd842dce940, transno 4294967307 00000004:00080000:0.0:1787857209.165613:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787857209.165657:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd96d8b5680, transno 4294967310 00000100:00100000:0.0:1787857209.165699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857209.800820:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857210.030309:0:12501:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857210.030319:0:12501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857210.030363:0:12501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787857210.030371:0:12501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787857210.204145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857210.206045:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863087488 00000100:00100000:1.0:1787857210.206060:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863087488 00000100:00100000:1.0:1787857210.206139:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 236 00000100:00100000:1.0:1787857210.206150:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+30:11631:x1874703863087488:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857210.206175:0:8856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857210.206197:0:8856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bcf expref: -99 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857210.206308:0:8856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf77e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857210.206324:0:8856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf77e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857210.206336:0:8856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf77e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857210.206347:0:8856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787857210.206476:0:8856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbf777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bcf expref: 33 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857210.206511:0:8856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf77e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bcf expref: 32 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857210.206520:0:8856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:1.0:1787857210.206523:0:8856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857210.206526:0:8856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978600, rc 0) 00000100:00100000:1.0:1787857210.206588:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b555e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:11631:x1874703863087488:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 440us (2452us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787857210.206595:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 236 00000100:00080000:0.0:1787857210.207565:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857210.221780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857210.221937:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863087616 00000100:00100000:3.0:1787857210.221949:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863087616 00000100:00100000:3.0:1787857210.222004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 237 00000100:00100000:3.0:1787857210.222013:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:11631:x1874703863087616:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:3.0:1787857210.222091:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222108:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222121:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222154:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222160:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222180:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857210.222185:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222193:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222205:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:3.0:1787857210.222208:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857210.222213:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857210.222219:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940031600/0xf326646fe3bbf78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857210.222280:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:11631:x1874703863087616:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 267us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857210.222288:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 237 00000100:00100000:0.0:1787857210.333868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857210.334044:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863087744 00000100:00100000:2.0:1787857210.334055:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863087744 00000100:00100000:2.0:1787857210.334163:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00100000:2.0:1787857210.334173:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2355:x1874703863087744:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1787857210.334190:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857210.334209:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b037a7d5/0xf326646fe3bbf793 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bd6 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857210.334234:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a908935, atime: 0x6a908935, ctime: 0x6a908935, blocks: 0xb 00010000:00010000:2.0:1787857210.334253:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787857210.334257:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857210.334267:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b037a7d5/0xf326646fe3bbf793 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bd6 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857210.334284:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b037a7d5/0xf326646fe3bbf793 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bd6 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857210.334297:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84c00, rc 0) 00000100:00100000:2.0:1787857210.334367:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b64d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2355:x1874703863087744:12345-192.168.204.29@tcp:101:cat.0 Request processed in 195us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857210.334375:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 71 00000100:00080000:0.0:1787857210.334611:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857210.339178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857210.339362:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863087872 00000100:00100000:2.0:1787857210.339372:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863087872 00002000:00100000:2.0:1787857210.339419:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fd97ba3e940 x1874703863087872/t0(0) o3->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:611/0 lens 488/0 e 0 to 0 dl 1787857221 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787857210.340346:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97ba3e940 with x1874703863087872 ext(0->4095) 00002000:00010000:2.0:1787857210.340353:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd97ba3e940 00000100:00100000:0.0:1787857210.340465:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1787857210.340480:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2354:x1874703863087872:12345-192.168.204.29@tcp:3:cat.0 00000100:00100000:0.0:1787857210.340856:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2354:x1874703863087872:12345-192.168.204.29@tcp:3:cat.0 Request processed in 379us (1687us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787857210.340865:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00002000:00100000:0.0:1787857210.340872:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fd97ba3e940 x1874703863087872/t0(0) o3->7c03cbb7-0a65-4fe4-91b3-312d9f1500f1@192.168.204.29@tcp:611/0 lens 488/4536 e 0 to 0 dl 1787857221 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787857210.340880:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9fd97ba3e940 with x1874703863087872 ext(0->4095) 00002000:00010000:0.0:1787857210.340884:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fd97ba3e940 00010000:00010000:0.0:1787857210.823790:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857211.747755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857211.747801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857211.747836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857211.747856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857211.747877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857211.748083:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088256 00000100:00100000:0.0:1787857211.748094:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088256 00000100:00100000:0.0:1787857211.748163:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088384 00000100:00100000:0.0:1787857211.748166:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088384 00000100:00100000:0.0:1787857211.748197:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:0.0:1787857211.748209:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863088256:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857211.748301:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b554780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2352:x1874703863088256:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 95us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857211.748309:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:0.0:1787857211.748327:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1787857211.748334:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863088384:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857211.748360:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+8:2352:x1874703863088384:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857211.748367:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:1.0:1787857211.748451:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088000 00000100:00100000:1.0:1787857211.748456:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088000 00000100:00100000:1.0:1787857211.748498:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 293 00000100:00100000:1.0:1787857211.748505:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863088000:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857211.748533:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863088000:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857211.748539:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 293 00000100:00100000:1.0:1787857211.748584:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088512 00000100:00100000:1.0:1787857211.748588:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088512 00000100:00100000:1.0:1787857211.748618:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088128 00000100:00100000:1.0:1787857211.748621:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088128 00000100:00100000:1.0:1787857211.748657:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:1.0:1787857211.748694:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863088512:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857211.748722:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b5543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72d67940-6689-4986-afc2-7832ffa90fe3+5:2352:x1874703863088512:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 31us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857211.748740:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 148 00000100:00100000:1.0:1787857211.748753:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00100000:1.0:1787857211.748760:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:2352:x1874703863088128:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857211.748784:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+32:2352:x1874703863088128:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 25us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857211.748790:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 149 00000100:00080000:3.0:1787857211.749923:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787857211.749931:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787857211.835167:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787857211.835189:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fd945b7d000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787857211.835195:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fd945b7da80 00000020:00080000:2.0:1787857211.835198:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fd9610f2100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fd96d8ef800 00000020:00080000:3.0:1787857211.835238:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:3.0:1787857211.835443:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787857211.835685:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1787857211.848252:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787857212.337010:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787857212.337030:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1787857212.337036:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1787857212.871853:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857213.257119:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885086720:0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.257200:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857213.257255:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857213.257262:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086848:0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.257288:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857213.257324:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086720 00000100:00100000:2.0:1787857213.257331:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086720 00000100:00100000:2.0:1787857213.257387:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787857213.257397:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885086720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.257451:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885086720:12345-0@lo:400:kworker.0 Request processed in 56us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857213.257458:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787857213.257483:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086848 00000100:00100000:2.0:1787857213.257488:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086848 00000100:00100000:2.0:1787857213.257519:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787857213.257525:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.257559:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885086848:12345-0@lo:400:kworker.0 Request processed in 33us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857213.257577:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787857213.257619:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885086848:0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.257630:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885086720:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.257761:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885086464:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.257798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857213.257825:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885086976:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.257846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857213.257863:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787857213.257868:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885086592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.257888:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857213.258042:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885087104:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.258069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857213.258096:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086976 00000100:00100000:1.0:1787857213.258115:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086976 00000100:00100000:1.0:1787857213.258142:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086592 00000100:00100000:1.0:1787857213.258145:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086592 00000100:00100000:1.0:1787857213.258162:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787857213.258168:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.258203:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885086976:12345-0@lo:400:kworker.0 Request processed in 35us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857213.258210:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787857213.258229:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787857213.258235:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885086592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.258264:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885086592:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857213.258270:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787857213.258293:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087104 00000100:00100000:1.0:1787857213.258296:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087104 00000100:00100000:1.0:1787857213.258319:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787857213.258325:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885087104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.258352:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885087104:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857213.258359:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787857213.258704:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885086592:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.260151:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787857213.260161:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd975484000, transno 4294967322 00000004:00080000:1.0:1787857213.260175:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787857213.260197:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885087104:0@lo:400:kworker.0 00000100:00100000:1.0:1787857213.260683:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885086976:0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.261002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885086464 00000100:00100000:2.0:1787857213.261010:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885086464 00000100:00100000:2.0:1787857213.261056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787857213.261065:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885086464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857213.261185:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885086464:12345-0@lo:400:kworker.0 Request processed in 120us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857213.261192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787857213.261231:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885086464:0@lo:400:kworker.0 00000100:00080000:3.0:1787857213.264604:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857213.264614:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787857213.264623:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857213.265513:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787857213.265541:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885087232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857213.265644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857213.265886:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087232 00000100:00100000:3.0:1787857213.265897:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087232 00000100:00100000:3.0:1787857213.267112:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787857213.267129:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885087232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787857213.267181:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857213.267251:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885087232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857213.267257:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787857213.267304:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885087232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787857213.896654:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857214.280687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885087360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857214.280765:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857214.280965:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087360 00000100:00100000:1.0:1787857214.280974:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087360 00000100:00100000:1.0:1787857214.281030:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787857214.281047:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885087360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787857214.281082:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857214.281128:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b6a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885087360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857214.281153:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787857214.281510:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885087360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857214.921625:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857215.943974:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857215.995101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857215.995211:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088640 00000100:00100000:2.0:1787857215.995221:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088640 00000100:00100000:2.0:1787857215.995295:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 238 00000100:00100000:2.0:1787857215.995304:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11284:x1874703863088640:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787857215.995414:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11284:x1874703863088640:12345-192.168.204.29@tcp:60:lhsmtool_posix.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857215.995422:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 238 00000100:00080000:3.0:1787857215.995791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857216.003502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857216.003618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863088896 00000100:00100000:2.0:1787857216.003640:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863088896 00000100:00100000:2.0:1787857216.003731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 65 00000100:00100000:2.0:1787857216.003741:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:11284:x1874703863088896:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857216.004458:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:11284:x1874703863088896:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 717us (964us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787857216.004468:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 65 00000040:00080000:0.0:1787857216.136130:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787857216.136145:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857216.136503:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787857216.136511:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787857216.525849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.526492:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089024 00000100:00100000:1.0:1787857216.526506:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089024 00000100:00100000:1.0:1787857216.526726:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 239 00000100:00100000:1.0:1787857216.526738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+5:12083:x1874703863089024:12345-192.168.204.29@tcp:101:lsof.0 00010000:00010000:1.0:1787857216.526768:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857216.526796:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bdd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.526881:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.526899:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.526928:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857216.527198:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787857216.527203:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857216.527290:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.527320:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978400/0xf326646fe3bbf79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bdd expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.527341:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bdd expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857216.527360:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:1.0:1787857216.527363:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857216.527368:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978c00, rc 0) 00000100:00100000:1.0:1787857216.527464:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:12083:x1874703863089024:12345-192.168.204.29@tcp:101:lsof.0 Request processed in 727us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857216.527472:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 239 00000100:00080000:3.0:1787857216.527776:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857216.871637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.871704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.871734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.871878:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.871917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857216.871948:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089664 00000100:00100000:1.0:1787857216.871960:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089664 00000100:00100000:1.0:1787857216.872011:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089280 00000100:00100000:1.0:1787857216.872014:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089280 00000100:00100000:1.0:1787857216.872033:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:1.0:1787857216.872042:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:2355:x1874703863089664:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857216.872523:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72d67940-6689-4986-afc2-7832ffa90fe3+6:2355:x1874703863089664:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 479us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857216.872589:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 153 00000100:00100000:1.0:1787857216.872610:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:1.0:1787857216.872617:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2355:x1874703863089280:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857216.872657:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:2355:x1874703863089280:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 40us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857216.872700:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 154 00000100:00100000:1.0:1787857216.872723:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089408 00000100:00100000:1.0:1787857216.872727:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089408 00000100:00100000:2.0:1787857216.872876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089152 00000100:00100000:2.0:1787857216.872881:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089152 00000100:00100000:2.0:1787857216.872920:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 295 00000100:00100000:2.0:1787857216.872928:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863089152:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857216.872956:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2355:x1874703863089152:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 30us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857216.872962:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 295 00000100:00100000:3.0:1787857216.873388:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089536 00000100:00100000:3.0:1787857216.873393:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089536 00000100:00100000:1.0:1787857216.873445:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:1.0:1787857216.873451:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863089408:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857216.873481:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2355:x1874703863089408:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857216.873486:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:2.0:1787857216.881178:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1787857216.881195:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2355:x1874703863089536:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857216.881313:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2355:x1874703863089536:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 123us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857216.881322:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00080000:1.0:1787857216.888024:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857216.888036:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787857216.927461:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787857216.927477:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787857216.928601:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787857216.928625:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787857216.968593:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857217.992482:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857218.376803:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885087488:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.376931:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.377025:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885088000:0@lo:400:kworker.0 00000100:00100000:3.0:1787857218.377079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885087872:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.377130:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787857218.377140:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857218.377177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.377197:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885088128:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.377273:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087488 00000100:00100000:2.0:1787857218.377281:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087488 00000100:00100000:2.0:1787857218.377338:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787857218.377347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885087488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377409:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885087488:12345-0@lo:400:kworker.0 Request processed in 62us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.377417:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787857218.377455:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088000 00000100:00100000:2.0:1787857218.377459:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088000 00000100:00100000:2.0:1787857218.377502:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787857218.377510:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885088000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377548:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885088000:12345-0@lo:400:kworker.0 Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.377555:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787857218.377578:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087616 00000100:00100000:2.0:1787857218.377582:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087616 00000100:00100000:2.0:1787857218.377623:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787857218.377632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.377638:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885087616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857218.377712:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857218.377741:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787857218.377758:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885087744:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377768:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885087616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.377785:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787857218.377815:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088128 00000100:00100000:2.0:1787857218.377822:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088128 00000100:00100000:2.0:1787857218.377854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087872 00000100:00100000:2.0:1787857218.377857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087872 00000100:00100000:2.0:1787857218.377891:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787857218.377900:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885088128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377940:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885088128:12345-0@lo:400:kworker.0 Request processed in 43us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.377947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787857218.377959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787857218.377964:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885087872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.377993:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885087872:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.377998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1787857218.378018:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787857218.378024:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787857218.378026:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857218.378079:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885087616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857218.378092:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885088128:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378101:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885088000:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378111:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885087488:0@lo:400:kworker.0 00000100:00100000:3.0:1787857218.378258:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.378296:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885087744 00000100:00100000:3.0:1787857218.378303:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885088256:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378305:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885087744 00000100:00100000:2.0:1787857218.378352:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787857218.378355:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857218.378375:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885087744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857218.378405:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885087872:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378428:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885087744:12345-0@lo:400:kworker.0 Request processed in 55us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.378438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787857218.378460:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885087744:0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378485:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088256 00000100:00100000:2.0:1787857218.378491:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088256 00000100:00100000:2.0:1787857218.378524:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787857218.378533:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885088256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857218.378583:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885088256:12345-0@lo:400:kworker.0 Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857218.378590:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787857218.378995:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885088256:0@lo:400:kworker.0 00010000:00010000:0.0:1787857219.016804:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857219.404180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857219.404226:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885088384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857219.404322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857219.404610:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088384 00000100:00100000:0.0:1787857219.404620:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088384 00000100:00100000:0.0:1787857219.404746:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787857219.404757:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885088384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857219.404806:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857219.404882:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885088384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857219.404890:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787857219.405057:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885088384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857220.040035:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857221.005860:0:12705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:00:18 (1787857218) 00010000:00010000:2.0:1787857221.063849:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857221.995991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857221.997439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857221.997476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857221.997501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857221.997533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857221.997611:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863090048 00000100:00100000:0.0:1787857221.997621:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863090048 00000100:00100000:0.0:1787857221.997724:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863090176 00000100:00100000:0.0:1787857221.997728:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863090176 00000100:00100000:0.0:1787857221.997754:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1787857221.997765:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863090048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857221.997859:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2353:x1874703863090048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857221.997867:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1787857221.997886:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:0.0:1787857221.997895:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863090176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857221.997922:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2352:x1874703863090176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857221.997929:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00080000:1.0:1787857222.000290:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787857222.000301:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857222.006821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863090304 00000100:00100000:3.0:1787857222.006838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863090304 00000100:00100000:3.0:1787857222.006926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089920 00000100:00100000:3.0:1787857222.006930:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089920 00000100:00100000:3.0:1787857222.006962:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:3.0:1787857222.006972:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863090304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857222.007071:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+6:2353:x1874703863090304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 101us (9594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857222.007080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 158 00000100:00100000:3.0:1787857222.007117:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00100000:3.0:1787857222.007124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:2352:x1874703863089920:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857222.007152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:2352:x1874703863089920:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 29us (9649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857222.007159:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 159 00000100:00080000:0.0:1787857222.007261:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857222.013729:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863089792 00000100:00100000:2.0:1787857222.013747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863089792 00000100:00100000:2.0:1787857222.013999:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 297 00000100:00100000:2.0:1787857222.014010:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863089792:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857222.014107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2353:x1874703863089792:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 92us (18124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857222.014115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 297 00010000:00010000:3.0:1787857222.087930:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857223.112591:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857223.496269:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857223.496292:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885088512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857223.496383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857223.497802:0:6879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088512 00000100:00100000:2.0:1787857223.497813:0:6879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088512 00000100:00100000:2.0:1787857223.497869:0:6879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787857223.497886:0:6879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885088512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857223.497919:0:6879:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857223.498003:0:6879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885088512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857223.498012:0:6879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787857223.498034:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857223.498093:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885088512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857223.500128:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885088768:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857223.500263:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857223.500270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885088896:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500294:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857223.500346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088768 00000100:00100000:0.0:1787857223.500354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088768 00000100:00100000:0.0:1787857223.500552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088896 00000100:00100000:0.0:1787857223.500556:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088896 00000100:00100000:0.0:1787857223.500609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787857223.500617:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500700:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885088768:12345-0@lo:400:kworker.0 Request processed in 83us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857223.500707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787857223.500726:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787857223.500732:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885088896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500761:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885088896:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857223.500779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1787857223.500801:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857223.500836:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885088896:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500848:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885088768:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500877:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885088640:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857223.500937:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885089152:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.500960:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857223.501097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885088640 00000100:00100000:0.0:1787857223.501103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885088640 00000100:00100000:0.0:1787857223.501130:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787857223.501137:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.501171:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958402850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885088640:12345-0@lo:400:kworker.0 Request processed in 35us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857223.501177:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787857223.501206:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089152 00000100:00100000:0.0:1787857223.501234:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089152 00000100:00100000:0.0:1787857223.501268:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787857223.501275:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885089152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.501306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885089152:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857223.501313:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1787857223.504190:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857223.504530:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885088640:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.504551:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885089152:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.504583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857223.504595:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885089024:0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.504720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857223.504775:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089024 00000100:00100000:0.0:1787857223.504781:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089024 00000100:00100000:0.0:1787857223.504837:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787857223.504847:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885089024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857223.504893:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885089024:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857223.504900:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787857223.504921:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857223.504937:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885089024:0@lo:400:kworker.0 00010000:00010000:1.0:1787857224.136013:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857224.527119:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885089280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857224.527198:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857224.527402:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089280 00000100:00100000:0.0:1787857224.527412:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089280 00000100:00100000:0.0:1787857224.527483:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787857224.527695:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885089280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857224.527740:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857224.527828:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885089280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 336us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857224.527836:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857224.527946:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd96d8eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885089280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857225.160155:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857225.676860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857225.677031:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863090560 00000100:00100000:2.0:1787857225.677042:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863090560 00000100:00100000:2.0:1787857225.677120:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00080000:0.0:1787857225.677124:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857225.677135:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+19:12305:x1874703863090560:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:2.0:1787857225.677759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:12305:x1874703863090560:12345-192.168.204.29@tcp:35:umount.0 Request processed in 626us (907us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787857225.677768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 66 00000100:00100000:2.0:1787857225.683870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857225.685522:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863090816 00000100:00100000:3.0:1787857225.685535:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863090816 00000100:00100000:3.0:1787857225.685607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:3.0:1787857225.685618:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+20:12305:x1874703863090816:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:3.0:1787857225.686005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:12305:x1874703863090816:12345-192.168.204.29@tcp:35:umount.0 Request processed in 387us (2143us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787857225.686013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 67 00000100:00100000:0.0:1787857225.689016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857225.689149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863091072 00000100:00100000:3.0:1787857225.689160:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863091072 00000100:00100000:3.0:1787857225.689267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:3.0:1787857225.689289:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd95d460c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+21:12305:x1874703863091072:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:3.0:1787857225.689777:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd95d460c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:12305:x1874703863091072:12345-192.168.204.29@tcp:35:umount.0 Request processed in 489us (769us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787857225.689785:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 68 00000100:00100000:0.0:1787857225.697623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857225.697984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863091328 00000100:00100000:2.0:1787857225.697994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863091328 00000100:00100000:2.0:1787857225.698157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:2.0:1787857225.698169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:12305:x1874703863091328:12345-192.168.204.29@tcp:35:umount.0 00000100:00100000:2.0:1787857225.698888:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:12305:x1874703863091328:12345-192.168.204.29@tcp:35:umount.0 Request processed in 718us (1273us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787857225.698912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 69 00000100:00100000:1.0:1787857225.706550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857225.707053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857225.710607:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857225.710718:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857225.711595:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863091968 00000100:00100000:1.0:1787857225.711605:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863091968 00000100:00100000:1.0:1787857225.711701:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 72 00000100:00100000:1.0:1787857225.711711:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+7:2351:x1874703863091968:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:1.0:1787857225.711766:0:8078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbed59 00000020:00010000:1.0:1787857225.711774:0:8078:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fd96dd90800: total 0 00000100:00080000:1.0:1787857225.711778:0:8078:0:(import.c:65:import_set_state_nolock()) ffff9fd96dd94000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787857225.711815:0:8078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787857225.712176:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2351:x1874703863091968:12345-192.168.204.29@tcp:9:umount.0 Request processed in 466us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857225.712184:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 72 00000020:00010000:1.0:1787857225.712208:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fd96dd90800: total 0 00010000:00010000:1.0:1787857225.712228:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fd96dd90800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787857225.712298:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba173ac0/0xf326646fe3bbf0f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a08 expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.712333:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b037a7d5/0xf326646fe3bbf793 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bd6 expref: 3 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.712348:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fd96dd90800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787857225.712360:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857225.712362:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857225.712364:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787857225.712507:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857225.713127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863091456 00000100:00100000:2.0:1787857225.713137:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863091456 00000100:00100000:3.0:1787857225.713190:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863091584 00000100:00100000:3.0:1787857225.713196:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863091584 00000100:00100000:1.0:1787857225.713231:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863092096 00000100:00100000:1.0:1787857225.713234:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863092096 00000100:00100000:1.0:1787857225.713260:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1787857225.713465:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+15:2352:x1874703863091456:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857225.713483:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857225.713498:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d200/0xf326646fe3bbe819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882768 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.713529:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857225.713609:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+14:2352:x1874703863091456:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 341us (7069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857225.713617:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1787857225.713634:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1787857225.713640:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+13:2352:x1874703863091584:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857225.713650:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857225.713675:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982045600/0xf326646fe3bbea2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882833 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.713684:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857225.713702:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+12:2352:x1874703863091584:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 62us (6651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857225.713708:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1787857225.713721:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1787857225.713740:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+11:2353:x1874703863092096:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857225.713747:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857225.713755:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b800/0xf326646fe3bbe77f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882730 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.713764:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857225.713779:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2353:x1874703863092096:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 41us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857225.713785:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:1.0:1787857225.718463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857225.718611:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863092224 00000100:00100000:0.0:1787857225.718621:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863092224 00000100:00100000:0.0:1787857225.718709:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00100000:0.0:1787857225.718718:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+5:2351:x1874703863092224:12345-192.168.204.29@tcp:9:umount.0 00000020:00000080:0.0:1787857225.718757:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbeaf1 00000100:00080000:0.0:1787857225.718766:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9fd95051f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857225.718807:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787857225.719098:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+2:2351:x1874703863092224:12345-192.168.204.29@tcp:9:umount.0 Request processed in 379us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857225.719105:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 73 00000100:00080000:1.0:1787857225.719533:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787857225.719614:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857225.728557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857225.728656:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093248 00000100:00100000:2.0:1787857225.728696:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093248 00000100:00100000:2.0:1787857225.728754:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 240 00000100:00100000:2.0:1787857225.728764:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+23:2351:x1874703863093248:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:2.0:1787857225.728794:0:8075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe78d 00000020:00010000:2.0:1787857225.728810:0:8075:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fd975786800: total 0 00000100:00080000:2.0:1787857225.728815:0:8075:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787857225.728843:0:8075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787857225.729563:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7c03cbb7-0a65-4fe4-91b3-312d9f1500f1+22:2351:x1874703863093248:12345-192.168.204.29@tcp:39:umount.0 Request processed in 797us (1011us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787857225.729572:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 240 00000020:00010000:1.0:1787857225.730033:0:11155:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fd975786800: total 0 00010000:00010000:1.0:1787857225.730230:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fd975786800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1787857225.730280:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd953423a00) 00010000:00010000:1.0:1787857225.730285:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857225.730294:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560200/0xf326646fe3bbea73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882848 expref: 21 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730325:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857225.730327:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857225.730332:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbf0e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a01 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730344:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:1.0:1787857225.730347:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857225.730352:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560600/0xf326646fe3bbf754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bc1 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730364:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:1.0:1787857225.730366:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857225.730495:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216cc00/0xf326646fe3bbf157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a24 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730516:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:1.0:1787857225.730518:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787857225.730522:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbf77e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bcf expref: 17 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730534:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857225.730551:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787857225.730556:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982044000/0xf326646fe3bbf0a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829f3 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730571:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:1.0:1787857225.730574:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787857225.730578:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560800/0xf326646fe3bbf452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882afd expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730589:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857225.730592:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787857225.730595:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975561000/0xf326646fe3bbedb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88292f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730607:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd946159700) 00010000:00010000:1.0:1787857225.730609:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857225.730613:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd982045400/0xf326646fe3bbea57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882841 expref: 13 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730627:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fd949362500) 00010000:00010000:1.0:1787857225.730629:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857225.730632:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85000/0xf326646fe3bbf173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882a2b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730645:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857225.730647:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857225.730650:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd975560e00/0xf326646fe3bbefd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829bb expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730734:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fd963a5f400) 00010000:00010000:1.0:1787857225.730737:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857225.730742:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85400/0xf326646fe3bbf0d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8829fa expref: 10 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730757:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fd949362f00) 00010000:00010000:1.0:1787857225.730760:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787857225.730763:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd95341ae00/0xf326646fe3bbeac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88285d expref: 9 pid: 8856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730776:0:11155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fd949362300) 00010000:00010000:1.0:1787857225.730778:0:11155:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787857225.730782:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd98216de00/0xf326646fe3bbf674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882b89 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857225.730795:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fd975786800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1787857225.730809:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857225.730811:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857225.730813:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857226.186194:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787857226.375956:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787857226.375966:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787857226.376356:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787857226.376366:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787857227.108852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857227.108924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857227.109039:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093376 00000100:00100000:1.0:1787857227.109051:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093376 00000100:00100000:1.0:1787857227.109117:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 299 00000100:00100000:1.0:1787857227.109128:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703863093376:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857227.109209:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2352:x1874703863093376:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857227.109217:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 299 00000100:00100000:3.0:1787857227.109524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093504 00000100:00100000:3.0:1787857227.109529:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093504 00000100:00100000:3.0:1787857227.109579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00100000:3.0:1787857227.109587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+6:2352:x1874703863093504:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857227.109630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72d67940-6689-4986-afc2-7832ffa90fe3+6:2352:x1874703863093504:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 44us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857227.109637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 163 00000100:00080000:1.0:1787857227.109927:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1787857227.129278:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000001:00080000:3.0:1787857227.129291:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787857227.129416:0:5858:0:(genops.c:885:class_export_put()) final put ffff9fd975786800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857227.129507:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975786800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-MDT0000 00000020:00000080:2.0:1787857227.129779:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd96db87000 for lustre-MDT0000 00010000:00010000:1.0:1787857227.215853:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787857227.663214:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:3.0:1787857227.663225:0:7626:0:(genops.c:885:class_export_put()) final put ffff9fd96dd90800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857227.663388:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96dd90800/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-OST0001 00000020:00000080:2.0:1787857227.663451:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd96dd94000 for lustre-OST0001 00000100:00100000:2.0:1787857228.149518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857228.149618:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093632 00000100:00100000:0.0:1787857228.149629:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093632 00000100:00100000:0.0:1787857228.149748:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:0.0:1787857228.149759:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2354:x1874703863093632:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857228.149777:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857228.149809:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975560400/0xf326646fe3bbe85f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88277d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857228.149844:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857228.149908:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:2354:x1874703863093632:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 151us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857228.149916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1787857228.158234:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857228.158285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857228.158340:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093888 00000100:00100000:2.0:1787857228.158366:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093888 00000100:00100000:2.0:1787857228.158439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863093760 00000100:00100000:2.0:1787857228.158443:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863093760 00000100:00100000:2.0:1787857228.158463:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857228.158472:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+10:2354:x1874703863093888:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857228.158489:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857228.158511:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbea26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88282c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857228.158533:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857228.158606:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+9:2354:x1874703863093888:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 134us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857228.158614:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857228.158633:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1787857228.158640:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+8:2354:x1874703863093760:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857228.158649:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857228.158708:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a600/0xf326646fe3bbe866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa8827a7 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857228.158719:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857228.158739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2987e7f-14a3-4148-a584-48f35ac5eb2c+7:2354:x1874703863093760:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 99us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857228.158746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:2.0:1787857228.172254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857228.172347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094144 00000100:00100000:0.0:1787857228.172357:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094144 00000100:00100000:0.0:1787857228.172421:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:0.0:1787857228.172432:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+6:2351:x1874703863094144:12345-192.168.204.29@tcp:39:umount.0 00000020:00000080:0.0:1787857228.172477:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe874 00000020:00010000:0.0:1787857228.172488:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fd9756df000: total 0 00000100:00080000:0.0:1787857228.172495:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9fd9756d8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857228.172524:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787857228.172697:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fd9756df000: total 0 00010000:00010000:3.0:1787857228.172742:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fd9756df000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787857228.172783:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd946159500) 00010000:00010000:3.0:1787857228.172800:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787857228.172810:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbf7a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bdd expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857228.172833:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fd9756df000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787857228.172847:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857228.172850:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857228.172852:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857228.173034:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72d67940-6689-4986-afc2-7832ffa90fe3+3:2351:x1874703863094144:12345-192.168.204.29@tcp:39:umount.0 Request processed in 603us (791us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787857228.173043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 241 00000100:00100000:3.0:1787857228.229805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857228.229932:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094400 00000100:00100000:0.0:1787857228.229944:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094400 00000100:00100000:0.0:1787857228.230009:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 300 00000100:00100000:0.0:1787857228.230020:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+7:2351:x1874703863094400:12345-192.168.204.29@tcp:251:umount.0 00000020:00000080:0.0:1787857228.230088:0:5829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe76a 00000020:00010000:0.0:1787857228.230096:0:5829:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fd981e93800: total 0 00000100:00080000:0.0:1787857228.230102:0:5829:0:(import.c:65:import_set_state_nolock()) ffff9fd981e92800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787857228.230189:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f2987e7f-14a3-4148-a584-48f35ac5eb2c+3:2351:x1874703863094400:12345-192.168.204.29@tcp:251:umount.0 Request processed in 170us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857228.230198:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 300 00000020:00010000:2.0:1787857228.230642:0:11155:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fd981e93800: total 0 00010000:00010000:2.0:1787857228.230647:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857228.230739:0:11155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fd981e93800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787857228.230776:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975561c00/0xf326646fe3bbe820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa88276f expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857228.230806:0:11155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fd981e93800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787857228.230817:0:11155:0:(genops.c:885:class_export_put()) final put ffff9fd981e93800/f2987e7f-14a3-4148-a584-48f35ac5eb2c 00010000:00010000:2.0:1787857228.230836:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857228.230839:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857228.230840:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787857228.230890:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd981e93800/f2987e7f-14a3-4148-a584-48f35ac5eb2c for MGS 00000020:00000080:3.0:1787857228.230927:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd981e92800 for MGS 00010000:00010000:2.0:1787857228.234769:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857228.620329:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857228.620361:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885089408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857228.620439:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857228.622792:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089408 00000100:00100000:0.0:1787857228.622824:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089408 00000100:00100000:0.0:1787857228.622909:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787857228.622922:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885089408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857228.622965:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857228.623084:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885089408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857228.623093:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787857228.623352:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787857228.623404:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885089408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857228.628809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857228.628833:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885089536:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.628905:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857228.628960:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089536 00000100:00100000:3.0:1787857228.628968:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089536 00000100:00100000:3.0:1787857228.629017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787857228.629026:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885089536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629217:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958401450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3310:x1874703885089536:12345-0@lo:400:kworker.0 Request processed in 190us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857228.629224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787857228.629274:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857228.629282:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885089664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857228.629335:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089664 00000100:00100000:3.0:1787857228.629339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089664 00000100:00100000:3.0:1787857228.629367:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787857228.629373:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885089664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629419:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885089664:12345-0@lo:400:kworker.0 Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857228.629426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787857228.629469:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885089664:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629516:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885089792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857228.629569:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089792 00000100:00100000:3.0:1787857228.629573:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089792 00000100:00100000:3.0:1787857228.629604:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787857228.629610:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885089792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629643:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885089792:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857228.629649:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1787857228.629699:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857228.629717:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885089792:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629746:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885089920:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629773:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857228.629801:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885089920 00000100:00100000:3.0:1787857228.629805:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885089920 00000100:00100000:3.0:1787857228.629837:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787857228.629848:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885089920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629883:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885089920:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857228.629889:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787857228.629915:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885089920:0@lo:400:kworker.0 00000100:00080000:3.0:1787857228.629937:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787857228.629962:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885090048:0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.629987:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857228.630013:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090048 00000100:00100000:3.0:1787857228.630016:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090048 00000100:00100000:2.0:1787857228.630153:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885089536:0@lo:400:kworker.0 00000100:00080000:2.0:1787857228.630845:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857228.630934:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787857228.630947:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885090048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857228.631060:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885090048:12345-0@lo:400:kworker.0 Request processed in 117us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857228.631067:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787857228.635032:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885090048:0@lo:400:kworker.0 00000001:00100000:2.0:1787857228.715149:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857228.715158:0:6702:0:(genops.c:885:class_export_put()) final put ffff9fd95051a000/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 00000020:00000080:2.0:1787857228.715188:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd95051a000/7c03cbb7-0a65-4fe4-91b3-312d9f1500f1 for lustre-OST0000 00000020:00000080:2.0:1787857228.715230:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd95051f800 for lustre-OST0000 00010000:00010000:2.0:1787857229.259630:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857229.640158:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857229.640184:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885090176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787857229.640255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857229.644268:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090176 00000100:00100000:2.0:1787857229.644284:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090176 00000100:00100000:2.0:1787857229.644362:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787857229.644373:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885090176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857229.644421:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857229.644523:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885090176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (4267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857229.644548:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787857229.644703:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885090176:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1787857230.136536:0:12904:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787857230.144959:0:12904:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787857230.145008:0:12904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.145023:0:12904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.145032:0:12904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.145038:0:12904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.145064:0:12904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787857230.145068:0:12904:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787857230.145088:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857230.145092:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787857230.145098:0:12904:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787857230.145130:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd975334800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787857230.145271:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857230.145280:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857230.145288:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489200 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:2.0:1787857230.145292:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857230.145301:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857230.145367:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857230.145373:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787857230.145375:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787857230.145378:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787857230.145408:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857230.145414:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857230.145439:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857230.145447:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489200/0xf326646fe3bbe7ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7f6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857230.145457:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857230.145459:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857230.145467:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857230.145476:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857230.145493:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885090432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857230.145567:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857230.145652:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090432 00000100:00100000:2.0:1787857230.145681:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090432 00000100:00100000:0.0:1787857230.145814:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885090304:0@lo:39:umount.0 00000100:00100000:0.0:1787857230.145848:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857230.145883:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857230.145892:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3312:x1874703885090432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857230.145906:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857230.145921:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341bc00/0xf326646fe3bbe7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7ef expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857230.145934:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857230.145961:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3312:x1874703885090432:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857230.145969:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787857230.145990:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090304 00000100:00100000:0.0:1787857230.145992:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090304 00000100:00100000:0.0:1787857230.146015:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787857230.146020:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874703885090304:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787857230.146044:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe579 00000100:00080000:0.0:1787857230.146053:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9fd94e0c0000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787857230.146095:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1874703885090304:12345-0@lo:39:umount.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857230.146108:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787857230.146116:0:5838:0:(genops.c:885:class_export_put()) final put ffff9fd94e0c5000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787857230.146137:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787857230.146159:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd975334800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787857230.146166:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885090304:0@lo:39:umount.0 00000020:00000080:0.0:1787857230.146186:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd94e0c5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1787857230.146393:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857230.146396:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787857230.146399:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787857230.147869:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd94e0c0000 for lustre-MDT0000 00000100:00100000:0.0:1787857230.147913:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885090432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857230.151630:0:12904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.151675:0:12904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.151684:0:12904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.151691:0:12904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.151711:0:12904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857230.152395:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857230.152404:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.152412:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857230.152417:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.152427:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857230.152434:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857230.152459:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787857230.152462:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787857230.152500:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.152507:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857230.152545:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.152552:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd975561400/0xf326646fe3bbe7fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.152565:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857230.152567:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857230.152569:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857230.152578:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857230.152596:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885090560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857230.152695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857230.152867:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090560 00000100:00100000:1.0:1787857230.152875:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090560 00000100:00100000:1.0:1787857230.153027:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787857230.153037:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3311:x1874703885090560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857230.153050:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857230.153064:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a200/0xf326646fe3bbe804 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7fd expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857230.153075:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857230.153135:0:12904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153153:0:12904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153159:0:12904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153165:0:12904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153199:0:12904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857230.153207:0:12904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153213:0:12904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153219:0:12904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153225:0:12904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153235:0:12904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787857230.153240:0:12904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153246:0:12904:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153251:0:12904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153257:0:12904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153272:0:12904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787857230.153276:0:12904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787857230.153288:0:12904:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787857230.153326:0:12904:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787857230.153330:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787857230.153335:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787857230.153340:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787857230.153346:0:12904:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fd84304e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787857230.153352:0:12904:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fd97fc17800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787857230.153359:0:12904:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fd9756df000 72d67940-6689-4986-afc2-7832ffa90fe3 192.168.204.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787857230.153364:0:12904:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fd945a9cd70) has exports, disconnecting them 00000020:00080000:3.0:1787857230.153369:0:12904:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fd84304e800), last request at 1787857228 00000020:00000080:3.0:1787857230.153375:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe6ec 00000100:00080000:3.0:1787857230.153390:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd84304d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787857230.153428:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787857230.153433:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153438:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341b600 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857230.153441:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153447:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857230.153453:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857230.153458:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787857230.153461:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787857230.153462:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787857230.153485:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153490:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857230.153508:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153514:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341b600/0xf326646fe3bbe724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe72b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153525:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857230.153528:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153533:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341aa00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857230.153535:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153540:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857230.153546:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857230.153550:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787857230.153552:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787857230.153554:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787857230.153566:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153571:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857230.153576:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153588:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341aa00/0xf326646fe3bbea18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea1f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153597:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857230.153599:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153605:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031200 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:3.0:1787857230.153608:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153615:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787857230.153621:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857230.153626:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787857230.153628:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787857230.153629:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787857230.153652:0:8436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153679:0:8436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787857230.153691:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153697:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbe4d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe4df expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.153717:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857230.153719:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857230.153720:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857230.153743:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885090816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857230.154942:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857230.158413:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857230.158424:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857230.158578:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3311:x1874703885090560:12345-0@lo:103:ldlm_bl.0 Request processed in 5536us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857230.158592:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787857230.158653:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885090688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857230.158715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857230.159124:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090688 00000100:00100000:3.0:1787857230.159130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857230.159132:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090688 00000100:00100000:1.0:1787857230.159171:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090816 00000100:00100000:1.0:1787857230.159174:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090816 00000100:00100000:3.0:1787857230.159177:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885090944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857230.159202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857230.159226:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885090560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857230.159256:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885090944 00000100:00100000:3.0:1787857230.159259:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885090944 00000100:00100000:3.0:1787857230.159282:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787857230.159290:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+19:3309:x1874703885090688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857230.159303:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857230.159323:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd98216d800/0xf326646fe3bbe72b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe724 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.159343:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857230.159506:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+18:3309:x1874703885090688:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857230.159513:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787857230.159526:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857230.159532:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96107f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+17:3310:x1874703885090816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857230.159540:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857230.159549:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975561800/0xf326646fe3bbea1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbea18 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.159576:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857230.159704:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885090688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857230.159789:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96107f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+16:3310:x1874703885090816:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857230.159795:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857230.159841:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787857230.159848:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+15:3311:x1874703885090944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857230.159856:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857230.159865:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd953488600/0xf326646fe3bbe4df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe4d8 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857230.159876:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1787857230.159891:0:12904:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd84304e800): rc 0 00000020:00000080:2.0:1787857230.159895:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd84304e800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:3.0:1787857230.159902:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3311:x1874703885090944:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (700us total) trans 0 rc 0/0 00000020:00080000:2.0:1787857230.159907:0:12904:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fd97fc17800), last request at 1787857228 00000100:00100000:3.0:1787857230.159908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:2.0:1787857230.159915:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe621 00000100:00080000:2.0:1787857230.159924:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd97fc15800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787857230.159930:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885090944:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787857230.159946:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd84304e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1787857230.159948:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:77122e39-57f8-4b24-9fe4-5b00eda54f16:3310:1874703885090816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857230.159960:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787857230.159990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd84304d800 for lustre-MDT0000 00000020:00080000:2.0:1787857230.160004:0:12904:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd97fc17800): rc 0 00000020:00000080:2.0:1787857230.160006:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd97fc17800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787857230.160027:0:12904:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc032c3ff3ae0 00000100:00080000:2.0:1787857230.160051:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787857230.160055:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787857230.160069:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787857230.160140:0:12904:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787857230.160158:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd841207000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787857230.160173:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787857230.160175:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000020:00000080:3.0:1787857230.160270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fc17800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787857230.160300:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd97fc15800 for lustre-MDT0000 00000004:00080000:2.0:1787857230.160382:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787857230.160445:0:12904:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787857230.160456:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9db800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787857230.160494:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fd945a9cd70) has no exports 00000100:00100000:0.0:1787857230.160910:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885091072:0@lo:9:umount.0 00000100:00100000:0.0:1787857230.160959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857230.160994:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885091200:0@lo:9:umount.0 00000100:00100000:0.0:1787857230.161015:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857230.161050:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091072 00000100:00100000:0.0:1787857230.161056:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091072 00000100:00100000:0.0:1787857230.161103:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091200 00000100:00100000:0.0:1787857230.161106:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091200 00000100:00100000:0.0:1787857230.161132:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787857230.161141:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874703885091072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787857230.161165:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe66e 00000100:00080000:0.0:1787857230.161171:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9fd97fb98000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857230.163854:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787857230.164265:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3308:x1874703885091072:12345-0@lo:9:umount.0 Request processed in 3120us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857230.164277:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787857230.164377:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787857230.164405:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874703885091200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787857230.164434:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe763 00000100:00080000:0.0:1787857230.164444:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9fd975781000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787857230.164479:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787857230.164705:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3308:x1874703885091200:12345-0@lo:9:umount.0 Request processed in 305us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857230.164711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787857230.164876:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857230.164881:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787857230.164896:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857230.164903:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787857230.165599:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd841207000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787857230.165618:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787857230.165621:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787857230.165627:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885091072:0@lo:9:umount.0 00000100:00080000:2.0:1787857230.165652:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9db800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787857230.165683:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787857230.165686:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787857230.165689:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885091200:0@lo:9:umount.0 00000020:00080000:0.0:1787857230.182516:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fd945a9cd70) has no exports 00000020:00000080:0.0:1787857230.224956:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe533 00000020:00000080:0.0:1787857230.224974:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd96d9a5000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787857230.225025:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787857230.225081:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96d9a5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787857230.225106:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787857230.225115:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787857230.225120:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fd9769999d0) has no exports 00000020:00000080:2.0:1787857230.225585:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe52c 00000020:00000080:2.0:1787857230.225592:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd97a68e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787857230.225704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a68e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787857230.226018:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787857230.226025:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787857230.226029:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd97535f000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787857230.226031:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97535f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787857230.226036:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787857230.281588:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857231.307465:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787857232.286168:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72d67940-6689-4986-afc2-7832ffa90fe3 00000001:00080000:3.0:1787857232.286185:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787857232.286190:0:5858:0:(genops.c:885:class_export_put()) final put ffff9fd9756df000/72d67940-6689-4986-afc2-7832ffa90fe3 00000020:00000080:2.0:1787857232.286628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9756df000/72d67940-6689-4986-afc2-7832ffa90fe3 for lustre-MDT0000 00000020:00000080:2.0:1787857232.286718:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9756d8000 for lustre-MDT0000 00010000:00010000:0.0:1787857232.329399:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787857232.788391:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787857232.788399:0:7626:0:(genops.c:885:class_export_put()) final put ffff9fd975787000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787857232.788489:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975787000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787857232.788792:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd975781000 for lustre-OST0001 00010000:00010000:0.0:1787857233.353193:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857233.736107:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857233.736133:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885091328:0@lo:400:kworker.0 00000100:00100000:3.0:1787857233.736225:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885091584:0@lo:400:kworker.0 00000100:00100000:1.0:1787857233.736234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857233.736294:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857233.736306:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091328 00000100:00100000:1.0:1787857233.736314:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091328 00000100:00100000:3.0:1787857233.736332:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857233.736341:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885091456:0@lo:400:kworker.0 00000100:00100000:1.0:1787857233.736371:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787857233.736372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857233.736386:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3311:x1874703885091328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857233.736411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091584 00000100:00100000:3.0:1787857233.736417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091584 00000100:00100000:1.0:1787857233.736444:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd958400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77122e39-57f8-4b24-9fe4-5b00eda54f16+14:3311:x1874703885091328:12345-0@lo:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857233.736446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091456 00000100:00100000:3.0:1787857233.736450:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091456 00000100:00100000:1.0:1787857233.736455:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787857233.736473:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787857233.736480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874703885091584:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787857233.736487:0:5837:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787857233.736511:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885091328:0@lo:400:kworker.0 00000100:00100000:3.0:1787857233.736529:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874703885091584:12345-0@lo:400:kworker.0 Request processed in 47us (234us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787857233.736536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787857233.736552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787857233.736557:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874703885091456:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787857233.736563:0:5837:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787857233.736599:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874703885091456:12345-0@lo:400:kworker.0 Request processed in 41us (230us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787857233.736605:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787857233.736631:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787857233.736635:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787857233.736639:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787857233.767900:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787857233.767918:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 185 00000100:00080000:3.0:1787857233.767931:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fd9774a9000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857233.768060:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f07840 x1874703885091712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857233.768090:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885091456:0@lo:400:kworker.0 00000100:00080000:3.0:1787857233.768145:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787857233.768150:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787857233.768154:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787857233.768157:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787857233.768161:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 204 00000100:00080000:3.0:1787857233.768166:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fd96d9df800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857233.768181:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f05e00 x1874703885091840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857233.768192:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885091584:0@lo:400:kworker.0 00000100:00100000:0.0:1787857233.768499:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885091712:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787857233.768588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857233.768630:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885091840:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787857233.768656:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857233.768714:0:8856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091712 00000100:00100000:3.0:1787857233.768722:0:8856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091712 00000100:00100000:0.0:1787857233.768722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885091840 00000100:00100000:0.0:1787857233.768728:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885091840 00000100:00100000:3.0:1787857233.768765:0:8856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787857233.768773:0:8856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1874703885091712:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787857233.768790:0:8856:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787857233.778388:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787857233.778403:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885091840:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787857233.778425:0:5836:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787857233.778531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885091840:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 129us (9873us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787857233.778553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787857233.778823:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857233.778829:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787857233.778834:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885091840:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787857233.789026:0:8856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1874703885091712:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 20246us (20431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787857233.789040:0:8856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787857233.791496:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857233.791510:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787857233.791516:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885091712:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1787857233.833278:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787857233.833294:0:6702:0:(genops.c:885:class_export_put()) final put ffff9fd97fb9e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787857233.833381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fb9e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787857233.833449:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd97fb98000 for lustre-OST0000 00010000:00010000:2.0:1787857234.376348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857235.399834:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787857236.296994:0:12904:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd9756afc60 - data ffff9fd95de58798/ffff9fd975b1ec00 00000020:01000000:2.0:1787857236.297128:0:12904:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd950628420 - data ffff9fd95dd4a510/ffff9fd96e969c00 00000001:00000004:2.0:1787857236.304154:0:12904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787857236.391356:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787857236.391365:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787857236.391771:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787857236.391775:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787857236.392442:0:6873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787857236.392448:0:6873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787857236.392458:0:6873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787857236.394578:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787857236.394585:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787857236.394595:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787857236.394598:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787857236.396170:0:8073:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787857236.396177:0:8073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787857236.396186:0:8073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:0.0:1787857236.424136:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787857236.482377:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe4fb 00000020:00000080:0.0:1787857236.482391:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd95d49f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787857236.482545:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd95d49f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787857236.484163:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe510 00000020:00000080:0.0:1787857236.484175:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd975d07000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787857236.484203:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787857236.484214:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.484223:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787857236.484227:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fd945a98000) has no exports 00000020:00000080:3.0:1787857236.484287:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975d07000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1787857236.487942:0:12904:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787857236.487959:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe74e 00000020:00000080:0.0:1787857236.487972:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd9497f2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787857236.488038:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787857236.488046:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.488058:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787857236.488062:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fd96db8b3a0) has no exports 00000020:00000080:0.0:1787857236.488070:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe747 00000020:00000080:0.0:1787857236.488075:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd96d9dd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787857236.488629:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd9497f2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787857236.489183:0:12904:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787857236.489189:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787857236.489194:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787857236.489200:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787857236.489203:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787857236.489243:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787857236.489251:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857236.489258:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe667 00000020:00000080:0.0:1787857236.489265:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd97fbfa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787857236.489270:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787857236.489286:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.489291:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787857236.489294:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fd942e14d70) has no exports 00000020:00000080:0.0:1787857236.489300:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe660 00000020:00000080:0.0:1787857236.489306:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd841202800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787857236.489496:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96d9dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787857236.490694:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd96d9db800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787857236.490706:0:38:0:(genops.c:885:class_export_put()) final put ffff9fd84304e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787857236.490710:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd84304e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787857236.490717:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787857236.490813:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fbfa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787857236.490819:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd841202800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787857236.491125:0:12904:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787857236.491131:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787857236.491135:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787857236.491146:0:12904:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787857236.491149:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787857236.491185:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787857236.491223:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd841207000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787857236.491256:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857236.491260:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd841207800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787857236.491263:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd841207800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787857236.491268:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857236.491562:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787857236.491568:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857236.491572:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd975337000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787857236.491574:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975337000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787857236.491580:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857236.491772:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe517 00000020:00000080:0.0:1787857236.491779:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd975d03800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787857236.491823:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787857236.491828:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.491833:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787857236.491836:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fd945a9b3a0) has no exports 00000020:00000080:0.0:1787857236.491857:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787857236.491861:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787857236.491865:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe51e 00000020:00000080:0.0:1787857236.491868:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd975d07800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787857236.491897:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975d03800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787857236.491901:0:38:0:(genops.c:885:class_export_put()) final put ffff9fd975332800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787857236.491903:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975332800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787857236.491907:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787857236.492150:0:12904:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd96116a000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787857236.492165:0:12904:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd96116a000 3 00000020:01000004:0.0:1787857236.492168:0:12904:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fd96116a000 from lustre-MDT0000 00000020:00000080:0.0:1787857236.492193:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787857236.492198:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787857236.492201:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd95d49a800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787857236.492204:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd95d49a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787857236.492212:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787857236.492240:0:12904:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787857236.492243:0:12904:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787857236.492246:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787857236.492249:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.492252:0:12904:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787857236.492259:0:12904:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fd96039f800 77122e39-57f8-4b24-9fe4-5b00eda54f16 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787857236.492265:0:12904:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fd942e133a0) has exports, disconnecting them 00000020:00080000:0.0:1787857236.492270:0:12904:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fd96039f800), last request at 1787857012 00000020:00000080:0.0:1787857236.492284:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe4bc 00000020:00010000:0.0:1787857236.492289:0:12904:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fd96039f800: total 1 00000100:00080000:0.0:1787857236.492294:0:12904:0:(import.c:65:import_set_state_nolock()) ffff9fd96b884800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787857236.492320:0:12904:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd96039f800): rc 0 00000020:00080000:0.0:1787857236.492325:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fd942e133a0) has no exports 00000020:00010000:1.0:1787857236.492371:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fd96039f800: total 1 00000100:00100000:0.0:1787857236.492383:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fd94578c600:5829] 0 exiting: rc = 1 00010000:00010000:1.0:1787857236.492411:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fd96039f800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787857236.492442:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341ba00/0xf326646fe3bbea03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe9fc expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492463:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975561600/0xf326646fe3bbe7e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7e1 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492483:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a400/0xf326646fe3bbea11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbea0a expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492496:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031000/0xf326646fe3bbe5d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe5cd expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492508:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341b200/0xf326646fe3bbe812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe80b expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492529:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd975561200/0xf326646fe3bbe7be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7b7 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492539:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a000/0xf326646fe3bbe7cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7c5 expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492549:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd95341a800/0xf326646fe3bbe7da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf326646fe3bbe7d3 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857236.492562:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fd96039f800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787857236.492576:0:5824:0:(genops.c:885:class_export_put()) final put ffff9fd96039f800/77122e39-57f8-4b24-9fe4-5b00eda54f16 00000100:00100000:0.0:1787857236.492620:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fd945aa7e00:5831] 2 exiting: rc = 0 00010000:00010000:1.0:1787857236.493083:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857236.493086:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857236.493088:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857236.493118:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fd945aa6600:5830] 1 exiting: rc = 0 00000020:00000080:3.0:1787857236.494153:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975d07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787857236.494169:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96039f800/77122e39-57f8-4b24-9fe4-5b00eda54f16 for MGS 00000100:00100000:0.0:1787857236.494548:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494562:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494571:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494580:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494589:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494597:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494604:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494612:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494736:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494743:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494760:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494765:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494772:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494777:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494782:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494795:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494802:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494807:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494813:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494819:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494824:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494829:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494834:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494840:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494846:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494852:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494858:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494863:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494868:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494874:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494879:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494885:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494892:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494897:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494903:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494908:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494913:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494918:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494923:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494928:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494933:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494938:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494943:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494949:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494954:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494968:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494974:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494979:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494985:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494990:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.494995:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495001:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495006:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495011:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495016:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495022:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495027:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495032:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495038:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495043:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495048:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495054:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495060:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857236.495066:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787857236.495480:0:12904:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787857236.495484:0:12904:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1787857236.496543:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd96b884800 for MGS 00000020:01000000:0.0:1787857236.497002:0:12904:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd9611a9960 - data ffff9fd97fecc5e8/ffff9fd975b17800 00000020:01000000:0.0:1787857236.497120:0:12904:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd9506c0de0 - data ffff9fd972b5d798/ffff9fd9610fe400 00000020:00000080:0.0:1787857236.497755:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe4a0 00000020:00000080:0.0:1787857236.497764:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd94592b000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787857236.497811:0:12904:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd96116a000 from MGS, refs=2 00000020:01000004:0.0:1787857236.497815:0:12904:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd96116a000 2 00000020:01000004:0.0:1787857236.497819:0:12904:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fd96116a000 from MGS 00000020:00000080:0.0:1787857236.497842:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787857236.497849:0:12904:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787857236.497852:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd94592f000/MGS 00000020:00000080:0.0:1787857236.497855:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd94592f000/MGS for MGS 00000020:01000000:0.0:1787857236.497862:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787857236.497918:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787857236.497933:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787857236.497939:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787857236.497946:0:12904:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fd975336800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787857236.497952:0:12904:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fd96d8c0000) has exports, disconnecting them 00000020:00080000:0.0:1787857236.497956:0:12904:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fd975336800), last request at 1787857013 00000020:00000080:0.0:1787857236.497961:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe56b 00000020:00080000:0.0:1787857236.498166:0:12904:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd975336800): rc 0 00000020:00000080:0.0:1787857236.498171:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd975336800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787857236.498288:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd94592b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787857236.499555:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975336800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787857236.499717:0:12904:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787857236.499722:0:12904:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787857236.499727:0:12904:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787857236.499732:0:12904:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787857236.499896:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787857236.499913:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787857236.499919:0:12904:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd96116a000 1 00000020:00000080:1.0:1787857236.499924:0:12904:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe492 00000020:00000080:1.0:1787857236.499931:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd94592c000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787857236.499935:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787857236.499939:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787857236.499943:0:12904:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787857236.499947:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fd945a999d0) has no exports 00000020:00000080:3.0:1787857236.500627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd975334800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787857236.500637:0:38:0:(genops.c:885:class_export_put()) final put ffff9fd975d00000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787857236.500639:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975d00000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787857236.500654:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787857236.500738:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd94592c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787857236.564442:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787857236.564458:0:12904:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787857236.564465:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd96116b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787857236.564470:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96116b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787857236.564479:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787857236.564640:0:12904:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fd96116f800 00000020:01000000:3.0:1787857236.564697:0:12904:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787857236.564702:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787857236.564709:0:12904:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787857236.564714:0:12904:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fd942e10000) has no exports 00000100:00100000:2.0:1787857236.564834:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fd95850c800:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1787857236.564983:0:8856:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fd97fb8a000:8856] 4 exiting: rc = 0 00000100:00100000:3.0:1787857236.565830:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fd945aa6400:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1787857236.565897:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fd95850d400:5838] 2 exiting: rc = 0 00000100:00100000:0.0:1787857236.589694:0:8075:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fd9612f8e00:8075] 3 exiting: rc = 0 00000100:00100000:1.0:1787857236.589972:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.589982:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.589990:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590007:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590014:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590021:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590033:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590039:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590050:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590056:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590061:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590068:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590074:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590083:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590093:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590103:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590112:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590120:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590128:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590136:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590143:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590151:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590160:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590168:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590177:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590185:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590193:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590211:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590217:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590223:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590229:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590234:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590241:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590246:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590252:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590258:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590264:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590270:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590276:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590282:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590287:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590293:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590299:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590305:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590311:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590316:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590323:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590330:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590335:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590340:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590346:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590352:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590357:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590363:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590370:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590375:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590382:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590388:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590394:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590399:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590405:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590410:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590422:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.590429:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857236.603921:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fd95850d200:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1787857236.604378:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fd95850d000:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1787857236.604772:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604781:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604795:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604801:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604807:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604813:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604873:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604881:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604887:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604893:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604898:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604904:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604912:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604916:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604922:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604927:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604932:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604937:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604942:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604947:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604951:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604956:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604962:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604968:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604975:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604981:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604987:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604992:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.604998:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605004:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605010:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605017:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605023:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605043:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605050:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605057:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605063:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605070:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605078:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605085:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605092:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605100:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605106:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605113:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605120:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605126:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605135:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605142:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605149:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605155:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605162:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605172:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605183:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605192:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605197:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605202:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605206:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605210:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605215:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605219:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605223:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605228:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605232:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.605237:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857236.608270:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fd958514800:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1787857236.610448:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fd958515400:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1787857236.610751:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610763:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610769:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610786:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610809:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610816:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610835:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610841:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610850:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610856:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610861:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610886:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610893:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610900:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610906:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610913:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610918:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610925:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610931:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610937:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610943:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610949:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610956:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610977:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610985:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610991:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.610998:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611004:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611010:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611016:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611022:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611028:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611034:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611040:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611051:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611075:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611082:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611087:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611093:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611108:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611114:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611119:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611125:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611130:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611136:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611142:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611148:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611168:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611175:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611180:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611186:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611192:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611198:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611203:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611209:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611216:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611221:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611227:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611234:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611255:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611262:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611268:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611274:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.611298:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857236.634035:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fd958515000:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1787857236.638955:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fd958515200:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1787857236.639378:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639387:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639392:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639399:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639404:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639410:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639416:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639421:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639426:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639432:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639437:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639442:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639447:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639452:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639457:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639463:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639468:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639473:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639479:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639484:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639489:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639494:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639499:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639504:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639509:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639528:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639533:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639539:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639544:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639548:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639553:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639558:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639564:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639569:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639592:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639598:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639605:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639611:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639615:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639620:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639625:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639630:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639635:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639640:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639645:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639650:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639655:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639689:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639696:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639701:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639707:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639712:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639718:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639723:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639728:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639734:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639739:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639745:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639750:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639755:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639760:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639765:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639770:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.639775:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.640243:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fd958514400:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1787857236.640439:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fd958514e00:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1787857236.641565:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641573:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641579:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641585:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641600:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641605:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641611:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641616:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641622:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641627:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641632:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641636:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641641:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641646:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641651:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641657:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641680:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641686:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641692:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641698:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641703:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641709:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641714:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641720:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641725:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641731:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641736:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641742:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641747:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641753:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641758:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641763:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641768:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641773:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641778:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641783:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641788:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641794:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641799:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641812:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641817:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641822:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641827:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641831:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641836:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641841:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641846:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641851:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641856:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641861:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641866:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641871:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641876:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641881:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641886:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641891:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641896:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641901:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641906:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641911:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641916:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641921:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641927:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.641933:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857236.642630:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fd97a61d400:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1787857236.645070:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fd97a61d600:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1787857236.645210:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645218:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645224:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645230:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645235:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645241:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645246:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645252:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645257:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645262:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645281:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645287:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645292:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645297:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645303:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645308:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645319:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645325:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645331:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645337:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645343:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645349:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645354:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645359:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645364:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645369:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645374:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645380:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645385:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645390:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645395:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645401:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645405:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645411:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645416:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645424:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645430:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645435:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645441:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645446:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645452:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645457:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645462:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645467:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645473:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645485:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645490:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645496:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645501:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645508:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645527:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645533:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645538:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645543:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645549:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645556:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645562:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645568:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645574:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645580:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645587:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645595:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645601:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.645610:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857236.648432:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fd97a61dc00:5851] 2 exiting: rc = 0 00000100:00100000:0.0:1787857236.649321:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fd97a61d000:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1787857236.651122:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fd97a61a000:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1787857236.651275:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651287:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651296:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651304:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651310:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651316:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651323:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651333:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651343:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651351:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651357:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651363:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651368:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651374:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651379:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651385:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651406:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651412:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651418:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651437:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651442:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651448:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651454:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651459:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651464:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651470:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651476:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651482:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651487:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651493:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651500:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651506:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651522:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651530:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651536:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651542:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651547:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651553:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651559:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651565:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651571:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651576:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651582:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651601:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651607:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651612:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651617:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651622:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651627:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651632:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651637:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651652:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651878:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651886:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651892:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651897:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651903:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651909:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.651915:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.652089:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.652097:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.652104:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.652109:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857236.652124:0:12904:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787857236.661275:0:12904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787857236.661288:0:12904:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787857236.661293:0:12904:0:(genops.c:885:class_export_put()) final put ffff9fd94592d000/MDS_uuid 00000020:00000080:2.0:1787857236.661298:0:12904:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd94592d000/MDS_uuid for MDS 00000020:01000000:2.0:1787857236.661303:0:12904:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787857236.661424:0:12904:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787857237.447828:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857238.472199:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857238.856075:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1787857238.857067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787857238.857074:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787857238.857078:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787857238.857086:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1787857238.857092:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787857238.857099:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fd9774a9000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857238.857127:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb58000 x1874703885092096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787857238.857143:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787857238.857146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787857238.857148:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787857238.857152:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1787857238.857155:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787857238.857158:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fd96d9df800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857238.857185:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb5b840 x1874703885092224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787857238.857372:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885092096:0@lo:38:kworker.0 00000400:00000100:1.0:1787857238.857433:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703885092096 offset 0 length 520: 4 00000100:00100000:1.0:1787857238.857502:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885092224:0@lo:38:kworker.0 00000400:00000100:1.0:1787857238.857523:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874703885092224 offset 0 length 520: 4 00000100:00100000:3.0:1787857238.863338:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885091968:0@lo:400:kworker.0 00000400:00000100:3.0:1787857238.863591:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874703885091968 offset 0 length 224: 4 00000020:01000004:1.0:1787857239.390277:0:13057:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787857239.398865:0:13057:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787857239.398912:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.398926:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.398941:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.398949:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.398973:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787857239.398978:0:13057:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787857239.399003:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787857239.399016:0:13057:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb58000 x1874703885092096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787857253 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857239.399034:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787857239.399041:0:13057:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787857239.399048:0:13057:0:(import.c:65:import_set_state_nolock()) ffff9fd9774a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787857239.399053:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787857239.399057:0:13057:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb58000 x1874703885092096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787857253 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857239.399064:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787857239.399067:0:13057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1787857239.399157:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885092096:0@lo:38:kworker.0 00010000:00010000:0.0:1787857239.399879:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857239.399888:0:11155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857239.399899:0:11155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857239.399903:0:11155:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857239.399913:0:11155:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857239.399921:0:11155:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857239.399928:0:11155:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787857239.399931:0:11155:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787857239.399934:0:11155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787857239.399972:0:11155:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857239.399979:0:11155:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857239.400002:0:11155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857239.400010:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953488400/0xf326646fe3bbe7d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7da expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857239.400023:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857239.400033:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857239.400036:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857239.400044:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857239.400061:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885092352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857239.400126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857239.400186:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885092352 00000100:00100000:0.0:1787857239.400193:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885092352 00000100:00100000:0.0:1787857239.400231:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787857239.400237:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874703885092352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787857239.400244:0:5821:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787857239 with bad export cookie 17520801832056382652 00010000:00010000:1.0:1787857239.400595:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400606:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400614:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400621:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400637:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857239.400648:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857239.400652:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400676:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd95341b000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857239.400680:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400687:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857239.400695:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857239.400700:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787857239.400703:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787857239.400719:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400736:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857239.400755:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400762:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd95341b000/0xf326646fe3bbe7e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbe7e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400772:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857239.400774:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857239.400776:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857239.400787:0:13057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400794:0:13057:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400800:0:13057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400806:0:13057:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400818:0:13057:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787857239.400822:0:13057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787857239.400825:0:13057:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787857239.400844:0:13057:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787857239.400849:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1787857239.400858:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857239.400863:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400879:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489c00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857239.400883:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400889:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857239.400896:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857239.400901:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787857239.400903:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787857239.400906:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787857239.400923:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400929:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857239.400937:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400944:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489c00/0xf326646fe3bbea0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf326646fe3bbea11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857239.400953:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857239.400954:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857239.400956:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787857239.400965:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787857239.400972:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787857239.400977:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fd97699b3a0) has no exports 00000020:00080000:1.0:1787857239.401004:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fd97699b3a0) has no exports 00000100:00100000:2.0:1787857239.401383:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885092480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857239.401433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857239.401486:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857239.401493:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885092608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857239.401516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857239.401538:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787857239.401546:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787857239.404838:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787857239.404865:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885092480 00000100:00100000:2.0:1787857239.404874:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885092480 00000100:00100000:2.0:1787857239.404907:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787857239.404912:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885092608 00000100:00100000:2.0:1787857239.404914:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885092608 00000020:01000000:1.0:1787857239.407038:0:13057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd97fa8dde0 - data ffff9fd95de80bd0/ffff9fd9756d4800 00000020:01000000:1.0:1787857239.407181:0:13057:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd9506c1ea0 - data ffff9fd960c59360/ffff9fd97fadbc00 00000100:00100000:3.0:1787857239.407654:0:13058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787857239.407679:0:13058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1874703885092480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787857239.407687:0:13058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787857239 with bad export cookie 17520801832056382652 00000100:00100000:3.0:1787857239.407782:0:13058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1874703885092480:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (6348us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787857239.407800:0:13058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787857239.407818:0:13058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787857239.407824:0:13058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1874703885092608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787857239.407828:0:13058:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787857239 with bad export cookie 17520801832056382652 00000100:00100000:3.0:1787857239.407858:0:13058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1874703885092608:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (6341us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787857239.407863:0:13058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787857239.408511:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787857239.408517:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9fd94592a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787857239.408521:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787857239.411515:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874703885092352:12345-0@lo:103:ldlm_bl.0 Request processed in 11269us (11382us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787857239.411530:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787857239.414835:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787857239.428849:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787857239.428856:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787857239.428868:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb5b480 x1874703885091968/t0(0) o400->MGC192.168.204.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787857254 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857239.428903:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb5b0c0 x1874703885092352/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787857255 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857239.428914:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd94a4bd2c0 x1874703885092480/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787857255 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857239.428923:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd94a4bc3c0 x1874703885092608/t0(0) o103->MGC192.168.204.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787857255 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787857239.428941:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787857239.428944:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787857239.428946:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787857239.428972:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:77122e39-57f8-4b24-9fe4-5b00eda54f16:3312:1874703885091968:0@lo:400:kworker.0 00000100:00080000:1.0:1787857239.428976:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fd94592a800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787857239.429854:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:77122e39-57f8-4b24-9fe4-5b00eda54f16:3311:1874703885092352:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787857239.432935:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9fd94592a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787857239.432952:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 166 00000100:00080000:2.0:1787857239.432963:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff9fd94592a800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857239.433115:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb5b0c0 x1874703885092736/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787857239.433174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885092480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857239.433198:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77122e39-57f8-4b24-9fe4-5b00eda54f16:3308:1874703885092736:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:0.0:1787857239.433202:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:77122e39-57f8-4b24-9fe4-5b00eda54f16:3309:1874703885092608:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1787857239.433260:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874703885092736 offset 0 length 520: 4 00100000:10000000:1.0:1787857239.446044:0:13057:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787857239.473323:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe5f0 00000020:00000080:2.0:1787857239.473336:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd97fc12800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787857239.473363:0:13057:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd950737800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787857239.473367:0:13057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd950737800 2 00000020:01000004:2.0:1787857239.473370:0:13057:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fd950737800 from lustre-OST0000 00000020:00000080:2.0:1787857239.473396:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787857239.473406:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787857239.473409:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd96d9df000/lustre-OST0000_UUID 00000020:00000080:2.0:1787857239.473412:0:13057:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96d9df000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787857239.473418:0:13057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787857239.473502:0:13057:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787857239.473506:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787857239.473510:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787857239.473515:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787857239.473522:0:13057:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fd97fc13800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787857239.473528:0:13057:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9fd841234d70) has exports, disconnecting them 00000020:00080000:2.0:1787857239.473533:0:13057:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fd97fc13800), last request at 1787857031 00000020:00000080:2.0:1787857239.473537:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe61a 00000020:00080000:2.0:1787857239.473548:0:13057:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd97fc13800): rc 0 00000020:00000080:2.0:1787857239.473553:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd97fc13800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787857239.474249:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fc12800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787857239.474263:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fc13800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787857239.475816:0:13057:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787857239.475882:0:13057:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857239.475886:0:13057:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787857239.475893:0:13057:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787857239.476088:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd9774a9000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787857239.476155:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787857239.476163:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787857239.476168:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd97fc16000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787857239.476172:0:13057:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97fc16000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787857239.476181:0:13057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787857239.476231:0:13057:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd950737800 1 00000020:00000080:3.0:1787857239.476236:0:13057:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe5aa 00000020:00000080:3.0:1787857239.476242:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd97a625800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787857239.476250:0:13057:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787857239.476254:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787857239.476258:0:13057:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787857239.476262:0:13057:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fd976998000) has no exports 00000020:00000080:0.0:1787857239.476417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a625800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:0.0:1787857239.505136:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787857239.516971:0:13057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787857239.516986:0:13057:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787857239.516991:0:13057:0:(genops.c:885:class_export_put()) final put ffff9fd97a624000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787857239.516996:0:13057:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a624000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787857239.517008:0:13057:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787857239.517112:0:13057:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fd97a620800 00000020:02000400:3.0:1787857239.517595:0:13057:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787857240.519788:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857241.544832:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787857242.212326:0:13210:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787857242.224831:0:13210:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787857242.224913:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.224929:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.224936:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.224942:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.224999:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787857242.225005:0:13210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787857242.225029:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857242.225041:0:13210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb5b840 x1874703885092224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787857253 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857242.225061:0:13210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787857242.225067:0:13210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787857242.225073:0:13210:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9df800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787857242.225077:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857242.225096:0:13210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb5b840 x1874703885092224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787857253 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857242.225104:0:13210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787857242.225107:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:0.0:1787857242.225536:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885092224:0@lo:38:kworker.0 00010000:00010000:1.0:1787857242.227264:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857242.227279:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857242.227290:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d400 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857242.227294:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857242.227305:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857242.227313:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857242.227318:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787857242.227321:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787857242.227325:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787857242.227343:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fd94592a800 00010000:00010000:1.0:1787857242.227347:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857242.227354:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd98216d400/0xf326646fe3bbe7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe7be expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857242.227387:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857242.227389:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857242.227391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857242.230347:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230367:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230375:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230381:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230396:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857242.230412:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230419:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230425:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230431:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857242.230445:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787857242.230464:0:13210:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787857242.230486:0:13210:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787857242.230490:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787857242.230494:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787857242.230499:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787857242.230503:0:13210:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fd96db8cd70) has no exports 00000020:00080000:3.0:1787857242.230527:0:13210:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fd96db8cd70) has no exports 00010000:00010000:0.0:1787857242.233134:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857242.233162:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233173:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953488800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857242.233176:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233186:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857242.233194:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857242.233199:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787857242.233201:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787857242.233204:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787857242.233223:0:8436:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fd94592a800 00010000:00010000:0.0:1787857242.233227:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233234:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953488800/0xf326646fe3bbe7c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233249:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857242.233253:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233258:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd953489800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857242.233261:0:8436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233285:0:8436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857242.233292:0:8436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857242.233298:0:8436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787857242.233300:0:8436:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787857242.233302:0:8436:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787857242.233307:0:8436:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fd94592a800 00010000:00010000:0.0:1787857242.233310:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233316:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489800/0xf326646fe3bbe9fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbea03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857242.233327:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857242.233329:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857242.233331:0:8436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857242.233341:0:11155:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787857242.236810:0:13210:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd97fa8d180 - data ffff9fd95dcdd288/ffff9fd9756d5000 00000020:01000000:2.0:1787857242.236973:0:13210:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fd97fa0d120 - data ffff9fd97fe77948/ffff9fd842e20c00 00100000:10000000:0.0:1787857242.258971:0:13210:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787857242.299284:0:13210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe6bb 00000020:00000080:2.0:1787857242.299294:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd975330800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787857242.299315:0:13210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd975d01000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787857242.299319:0:13210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd975d01000 2 00000020:01000004:2.0:1787857242.299322:0:13210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fd975d01000 from lustre-OST0001 00000020:00000080:2.0:1787857242.299346:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787857242.299356:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787857242.299358:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd981e97000/lustre-OST0001_UUID 00000020:00000080:2.0:1787857242.299361:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd981e97000/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:1.0:1787857242.299363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd975330800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787857242.299367:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787857242.299461:0:13210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 77122e39-57f8-4b24-9fe4-5b00eda54f16->MGS 00010000:00010000:2.0:1787857242.299477:0:13210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857242.299490:0:13210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857242.299497:0:13210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787857242.299511:0:13210:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787857242.299514:0:13210:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787857242.299529:0:13210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fd94592a800 00010000:00010000:2.0:1787857242.299533:0:13210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbe5cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe5d4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857242.299548:0:13210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787857242.299556:0:13210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857242.299566:0:13210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787857242.299568:0:13210:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787857242.299640:0:13210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787857242.299653:0:13210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fd94592a800 00010000:00010000:2.0:1787857242.299656:0:13210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd953489e00/0xf326646fe3bbe80b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf326646fe3bbe812 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787857242.299688:0:13210:0:(import.c:65:import_set_state_nolock()) ffff9fd94592a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787857242.299692:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787857242.299695:0:13210:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787857242.299696:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787857242.299699:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787857242.299855:0:13210:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fd97bb5b0c0 x1874703885092736/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787857249 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787857242.299922:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787857242.299925:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787857242.302437:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:77122e39-57f8-4b24-9fe4-5b00eda54f16:3308:1874703885092736:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1787857242.310011:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787857242.310032:0:13210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe4ae 00000020:00000080:2.0:1787857242.310053:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd945928800/77122e39-57f8-4b24-9fe4-5b00eda54f16 00000020:01000000:2.0:1787857242.310079:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.129@tcp (flags='') 00000020:00000080:2.0:1787857242.310109:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787857242.310117:0:13210:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787857242.310121:0:13210:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fd942e119d0) has no exports 00000020:00000080:3.0:1787857242.310219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd945928800/77122e39-57f8-4b24-9fe4-5b00eda54f16 for MGC192.168.204.129@tcp 10000000:01000000:3.0:1787857242.310258:0:5833:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787857242.310429:0:13210:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.129@tcp: client import never connected 00000100:00080000:2.0:1787857242.310433:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787857242.310436:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787857242.310439:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787857242.310441:0:13210:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787857242.310488:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787857242.310496:0:13210:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.129@tcp (uuid 77122e39-57f8-4b24-9fe4-5b00eda54f16) 00000020:01000000:2.0:1787857242.310501:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787857242.310505:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787857242.310509:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787857242.310516:0:13210:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fd97a688000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787857242.310521:0:13210:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9fd96d9b19d0) has exports, disconnecting them 00000020:00080000:2.0:1787857242.310526:0:13210:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fd97a688000), last request at 1787857050 00000020:00000080:2.0:1787857242.310530:0:13210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe6e5 00000020:00080000:2.0:1787857242.310541:0:13210:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fd97a688000): rc 0 00000020:00000080:2.0:1787857242.310545:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd97a688000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787857242.310899:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd94592a800 for MGC192.168.204.129@tcp 00000020:00000080:3.0:1787857242.310906:0:8:0:(genops.c:885:class_export_put()) final put ffff9fd95a2cf800/77122e39-57f8-4b24-9fe4-5b00eda54f16 00000020:00000080:3.0:1787857242.310908:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd95a2cf800/77122e39-57f8-4b24-9fe4-5b00eda54f16 for MGC192.168.204.129@tcp 00000020:01000000:3.0:1787857242.310913:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.129@tcp (77122e39-57f8-4b24-9fe4-5b00eda54f16) 00000020:00000080:3.0:1787857242.311988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a688000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787857242.314998:0:13210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787857242.315006:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787857242.315011:0:13210:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787857242.315018:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787857242.316169:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1787857242.316308:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fd96d9df800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787857242.316436:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787857242.316556:0:8436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787857242.316726:0:11155:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787857242.319179:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fd952abac00:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1787857242.319274:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fd94995b000:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1787857242.319371:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857242.319623:0:13058:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fd95852fc00:13058] 3 exiting: rc = 0 00000100:00100000:1.0:1787857242.319939:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fd9537fca00:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1787857242.320758:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fd9432a8000:5823] 2 exiting: rc = 0 00000100:00100000:0.0:1787857242.321723:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fd951366e00:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1787857242.322838:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322847:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322854:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322860:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322866:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322872:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322877:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322883:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322889:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322894:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322900:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322905:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322911:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322918:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322925:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322931:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322938:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322942:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322962:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322967:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322972:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322978:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322984:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322990:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.322996:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323002:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323007:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323014:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323019:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323024:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323029:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323035:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323041:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323173:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323183:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323189:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323196:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323201:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323207:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323212:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323218:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323223:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323229:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323234:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323240:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323245:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323262:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323268:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323273:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323279:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323285:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323290:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323295:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323309:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323314:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323319:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323325:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323330:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323335:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323341:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323346:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323351:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323357:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.323363:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787857242.328231:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787857242.328247:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787857242.328262:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd96db80000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787857242.328267:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd96db80000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787857242.328278:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787857242.328329:0:13210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd975d01000 1 00000020:00000080:1.0:1787857242.328334:0:13210:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf326646fe3bbe68a 00000020:00000080:1.0:1787857242.328341:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd981e94800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787857242.328362:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787857242.328366:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787857242.328370:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787857242.328374:0:13210:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fd96d9b33a0) has no exports 00000020:00000080:3.0:1787857242.328922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd981e94800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787857242.368323:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787857242.368339:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787857242.368345:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd97a622000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787857242.368349:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a622000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787857242.368357:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787857242.368622:0:13210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fd975d03000 00000020:01000000:1.0:1787857242.368652:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787857242.368656:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787857242.368705:0:13210:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787857242.368709:0:13210:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fd97699cd70) has no exports 00000020:00000080:1.0:1787857242.368751:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787857242.368758:0:13210:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787857242.368765:0:13210:0:(genops.c:885:class_export_put()) final put ffff9fd97a627000/OSS_uuid 00000020:00000080:1.0:1787857242.368770:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff9fd97a627000/OSS_uuid for OSS 00000020:01000000:1.0:1787857242.368774:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787857242.379237:0:5832:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787857242.379432:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fd945c1c200:6678] 1 exiting: rc = 0 00000100:00100000:0.0:1787857242.379496:0:8078:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fd97f96ca00:8078] 3 exiting: rc = 0 00000100:00100000:0.0:1787857242.379578:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fd975698c00:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1787857242.379638:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fd975699e00:6679] 2 exiting: rc = 0 00000100:00100000:1.0:1787857242.380315:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380324:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380331:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380337:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380342:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380348:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380353:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380358:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380363:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380369:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380373:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380378:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380383:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380387:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380469:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380474:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380480:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380486:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380552:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380557:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380562:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380568:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380572:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380578:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380583:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380588:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380593:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380598:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380603:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380608:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380624:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380629:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380634:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380639:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380644:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380650:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380655:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380680:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380686:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380691:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380696:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380702:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380707:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380712:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380717:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380722:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380727:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380793:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380803:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380809:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380814:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380820:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380825:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380830:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380835:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380840:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380845:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380849:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380854:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380858:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380863:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380868:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380873:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.380877:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857242.385146:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fd950976a00:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1787857242.390220:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fd950977000:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1787857242.390360:0:6879:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fd948ba6000:6879] 2 exiting: rc = 0 00000100:00100000:0.0:1787857242.390486:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390497:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390508:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390519:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390530:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390541:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390552:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390574:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390586:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390599:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390611:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390621:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390636:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390651:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.390684:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391066:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391077:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391083:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391088:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391093:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391098:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391104:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391110:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391117:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391127:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391138:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391150:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391160:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391171:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391182:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391194:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391204:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391215:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391226:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391237:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391257:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391267:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391279:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391289:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391302:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391325:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391336:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391347:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391359:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391370:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391382:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391392:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391411:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391424:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391435:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391446:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391459:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391469:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391478:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391486:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391491:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391501:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391511:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391521:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391531:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391541:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391552:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391574:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787857242.391586:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857242.395922:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fd96dd78600:6684] 2 exiting: rc = 0 00000100:00100000:1.0:1787857242.396418:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fd96dd79a00:6682] 0 exiting: rc = 1 00000100:00100000:2.0:1787857242.396463:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fd96dd78c00:6683] 1 exiting: rc = 0 00000100:00100000:1.0:1787857242.396512:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.396522:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.396531:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.396539:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.396549:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397449:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397456:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397468:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397474:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397527:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397534:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397539:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397544:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.397549:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398175:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398187:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398198:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398204:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398210:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398217:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398228:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398234:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398239:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398245:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398254:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398260:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398281:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398288:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398294:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398300:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398306:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398323:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398331:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398336:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398342:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398359:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398364:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398369:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398378:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398383:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398389:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398397:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398418:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398426:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398433:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398451:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398458:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398470:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398476:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398481:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398486:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398491:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398496:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398502:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398507:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398513:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398518:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398523:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398528:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398533:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398539:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398545:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398553:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.398570:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787857242.416888:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fd96dd78a00:6685] 0 exiting: rc = 1 00000100:00100000:0.0:1787857242.417057:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fd96dd79800:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1787857242.417274:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417282:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417287:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417292:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417297:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417303:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417390:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417397:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417414:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417419:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417424:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417429:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417434:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417439:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417444:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417449:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417455:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417460:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417466:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417471:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417477:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417483:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417488:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417493:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417498:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417503:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417508:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417513:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417519:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417524:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417530:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417534:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417540:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417545:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417551:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417556:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417572:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417578:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417584:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417589:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417595:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417608:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417614:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417619:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417624:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417629:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417635:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417640:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417646:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417652:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417674:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417681:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417691:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417708:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417713:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417718:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417724:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417729:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417737:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417744:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417750:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417756:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417761:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.417766:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787857242.419247:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fd96dd79400:6687] 0 exiting: rc = 1 00000100:00100000:3.0:1787857242.419644:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fd96dd79600:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1787857242.419812:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419904:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419913:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419920:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419926:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419932:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419939:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419954:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419961:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419967:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419973:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.419982:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420001:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420008:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420015:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420021:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420237:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420243:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420248:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420270:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420276:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420283:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420289:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420296:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420302:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420451:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420463:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420469:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420475:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420482:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420488:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420509:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420518:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420526:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420534:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420544:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420632:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420642:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420648:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.420655:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422459:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422473:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422481:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422537:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422545:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.422551:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.424632:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425156:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425165:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425171:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425178:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425187:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425197:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425204:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425213:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425241:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425251:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425257:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425266:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425272:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425279:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425285:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425292:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787857242.425299:0:13210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787857242.470222:0:13210:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787857258.817406:0:13822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787857267.275406:0:14296:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787857267.275421:0:14296:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787857267.275534:0:14296:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fd96dd97000 00000020:01000004:3.0:1787857267.275555:0:14296:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787857267.275563:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787857267.275577:0:14296:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fd96d9b0000) 00000020:00000080:3.0:1787857267.275592:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787857267.295023:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787857267.296981:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787857267.297380:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 423: rc = 0 00100000:10000000:3.0:1787857267.297529:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:3.0:1787857267.300373:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787857267.300481:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 423: rc = 0 00100000:10000000:3.0:1787857267.300685:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 423: rc = 0 00100000:10000000:3.0:1787857267.300798:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:3.0:1787857267.300909:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 423: rc = 0 00100000:10000000:3.0:1787857267.302151:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 425: rc = 0 00100000:10000000:3.0:1787857267.303245:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 542: rc = 0 00100000:10000000:3.0:1787857267.303348:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 542: rc = 0 00100000:10000000:3.0:1787857267.303799:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:3.0:1787857267.304148:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1787857267.304461:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1787857267.305385:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:2.0:1787857267.305805:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1787857267.306145:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1787857267.306415:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1787857267.308288:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1787857267.309475:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1787857267.310377:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1787857267.313619:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1787857267.315229:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1787857267.315753:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 286: rc = 0 00100000:10000000:2.0:1787857267.316112:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 286: rc = 0 00100000:10000000:2.0:1787857267.316361:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 286: rc = 0 00100000:10000000:2.0:1787857267.316605:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 286: rc = 0 00100000:10000000:2.0:1787857267.317065:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 286: rc = 0 00100000:10000000:2.0:1787857267.317333:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 286: rc = 0 00100000:10000000:2.0:1787857267.317584:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 286: rc = 0 00100000:10000000:2.0:1787857267.320070:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 286: rc = 0 00100000:10000000:2.0:1787857267.322077:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 286: rc = 0 00100000:10000000:2.0:1787857267.322883:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 286: rc = 0 00100000:10000000:2.0:1787857267.323331:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 286: rc = 0 00100000:10000000:2.0:1787857267.324124:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 286: rc = 0 00100000:10000000:2.0:1787857267.324823:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 286: rc = 0 00100000:10000000:2.0:1787857267.325191:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 286: rc = 0 00100000:10000000:2.0:1787857267.325841:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 286: rc = 0 00100000:10000000:2.0:1787857267.326194:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 286: rc = 0 00100000:10000000:2.0:1787857267.329155:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 286: rc = 0 00100000:10000000:2.0:1787857267.331262:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 286: rc = 0 00100000:10000000:2.0:1787857267.331575:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 286: rc = 0 00100000:10000000:2.0:1787857267.331964:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 286: rc = 0 00100000:10000000:2.0:1787857267.332497:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 286: rc = 0 00100000:10000000:2.0:1787857267.333036:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 286: rc = 0 00100000:10000000:2.0:1787857267.333586:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 286: rc = 0 00100000:10000000:2.0:1787857267.333983:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 286: rc = 0 00100000:10000000:2.0:1787857267.334420:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 286: rc = 0 00100000:10000000:3.0:1787857267.336623:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 286: rc = 0 00100000:10000000:3.0:1787857267.337116:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 286: rc = 0 00100000:10000000:3.0:1787857267.337394:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 286: rc = 0 00100000:10000000:3.0:1787857267.337727:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 286: rc = 0 00100000:10000000:3.0:1787857267.338022:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 286: rc = 0 00100000:10000000:3.0:1787857267.338269:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 286: rc = 0 00100000:10000000:3.0:1787857267.338521:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 286: rc = 0 00100000:10000000:3.0:1787857267.338939:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 275: rc = 0 00100000:10000000:3.0:1787857267.340369:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787857267.340620:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 692: rc = 0 00100000:10000000:3.0:1787857267.341032:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787857267.341100:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 692: rc = 0 00100000:10000000:3.0:1787857267.341286:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787857267.341356:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 692: rc = 0 00100000:10000000:3.0:1787857267.342037:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787857267.342113:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 543: rc = 0 00100000:10000000:3.0:1787857267.342307:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787857267.342381:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 543: rc = 0 00100000:10000000:3.0:1787857267.342752:0:14296:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787857267.342822:0:14296:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 543: rc = 0 00000020:00000080:3.0:1787857267.345772:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787857267.345786:0:14296:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787857267.345802:0:14296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf7af 00000020:01000004:3.0:1787857267.345811:0:14296:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787857267.345816:0:14296:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787857267.345822:0:14296:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd96dd97000 from MGS 00000020:01000004:3.0:1787857267.345825:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787857267.345838:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fd96d9b4d70) 00000020:00000080:3.0:1787857267.345850:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787857267.346021:0:14296:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd96dd97000 from MGS, refs=2 00080000:01000000:3.0:1787857267.346028:0:14296:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787857267.346033:0:14296:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf7bd 00000100:00100000:3.0:1787857267.346446:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787857267.346597:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787857267.346603:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787857267.347309:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787857267.347318:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787857267.349327:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787857267.349573:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787857267.349579:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787857267.353868:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787857267.353885:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787857267.354650:0:14296:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787857267.354753:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787857267.358003:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857267.358009:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857267.358012:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857267.358409:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857267.358412:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857267.358414:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857267.359109:0:14296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787857267.363643:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787857267.368955:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787857267.368973:0:14296:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787857267.368976:0:14296:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787857267.375941:0:14305:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787857267.376258:0:14296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787857267.376374:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787857267.377993:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787857267.378290:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787857267.378461:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787857267.380175:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787857267.385770:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787857267.385783:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787857267.386208:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787857267.386215:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787857267.387152:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787857267.387172:0:14296:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.129@tcp' 00000020:01000004:1.0:1787857267.387174:0:14296:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787857267.387202:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.129@tcp (typ=mgc) 00000020:00000080:1.0:1787857267.387215:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.129@tcp (ffff9fd8412333a0) 00000020:00000080:1.0:1787857267.387230:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1787857267.387370:0:14310:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1787857267.387432:0:14296:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd942f98800@MGC192.168.204.129@tcp: add connection 192.168.204.129@tcp at head 00010000:00010000:1.0:1787857267.387940:0:14296:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.129@tcp-0 is initialized 00000040:01000000:1.0:1787857267.387948:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787857267.388552:0:14311:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787857267.388625:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.129@tcp (uuid 64833f6a-f420-4926-9238-fdfd3153a5b1) 00000020:00000080:1.0:1787857267.388644:0:14296:0:(genops.c:1385:class_connect()) connect: client 64833f6a-f420-4926-9238-fdfd3153a5b1, cookie 0xf326646fe3bbf7cb 00000100:00080000:1.0:1787857267.388654:0:14296:0:(import.c:510:import_select_connection()) MGC192.168.204.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787857267.388698:0:14296:0:(import.c:624:import_select_connection()) MGC192.168.204.129@tcp: import ffff9fd942f98800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:1.0:1787857267.388729:0:14296:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd94a4be580 x1874703885092864/t0(0) o250->MGC192.168.204.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787857267.388751:0:14296:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 64833f6a-f420-4926-9238-fdfd3153a5b1->MGS 00000020:01000004:1.0:1787857267.388770:0:14296:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787857267.388775:0:14296:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787857267.388787:0:14296:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fd8412319d0) 00000020:00000080:1.0:1787857267.388800:0:14296:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787857267.389098:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64833f6a-f420-4926-9238-fdfd3153a5b1:3308:1874703885092864:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787857267.389164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857267.389696:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885092864 00000100:00100000:2.0:1787857267.389704:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885092864 00000100:00100000:2.0:1787857267.389744:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857267.389752:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1874703885092864:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787857267.389775:0:14307:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 64833f6a-f420-4926-9238-fdfd3153a5b1@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:2.0:1787857267.389798:0:14307:0:(genops.c:1385:class_connect()) connect: client 64833f6a-f420-4926-9238-fdfd3153a5b1, cookie 0xf326646fe3bbf7d9 00000100:00080000:2.0:1787857267.389932:0:14307:0:(import.c:65:import_set_state_nolock()) ffff9fd97fab6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857267.389994:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+5:3308:x1874703885092864:12345-0@lo:250:mount.lustre.0 Request processed in 241us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.390002:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857267.390035:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787857267.390043:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1787857267.390050:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787857267.390054:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787857267.390058:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd942f98800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787857267.390060:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787857267.390066:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787857267.390071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64833f6a-f420-4926-9238-fdfd3153a5b1:3308:1874703885092864:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787857267.413166:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787857267.413340:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787857267.413347:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787857267.418717:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787857267.418729:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787857267.423129:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787857267.423142:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787857267.424212:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787857267.424384:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787857267.424388:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787857267.425273:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787857267.425280:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787857267.457290:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857267.457577:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787857267.457585:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787857267.459073:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787857267.459085:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787857267.459700:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857267.459879:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787857267.459885:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787857267.460554:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787857267.460561:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787857267.461184:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857267.461355:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787857267.461361:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787857267.462073:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787857267.462082:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787857267.462888:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857267.463156:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787857267.463162:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787857267.463602:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787857267.463609:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787857267.480930:0:14296:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857267.481264:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787857267.481271:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787857267.483391:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787857267.483405:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787857267.485095:0:14296:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787857267.485114:0:14296:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787857267.486859:0:14296:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787857267.486890:0:14296:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787857267.486898:0:14296:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787857267.487145:0:14296:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787857267.487330:0:14296:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787857267.487335:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787857267.487336:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787857267.487338:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787857267.487340:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787857267.487341:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787857267.487342:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787857267.487344:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787857267.487346:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787857267.487348:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787857267.487349:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787857267.487356:0:14296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787857267.487358:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787857267.487359:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787857267.487360:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787857267.487361:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787857267.487362:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787857267.487364:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787857267.487365:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787857267.487366:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787857267.487367:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787857267.487368:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787857267.487397:0:14296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787857267.487418:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885092992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787857267.487579:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.487709:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.488125:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885092992 00000100:00100000:0.0:1787857267.488137:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885092992 00000100:00100000:0.0:1787857267.488227:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857267.488238:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+5:14296:x1874703885092992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787857267.488293:0:14309:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787857267.488296:0:14309:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787857267.488300:0:14309:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787857267.488714:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787857267.489202:0:14309:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787857267.491097:0:14331:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787857267.491104:0:14331:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787857267.491107:0:14331:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787857267.491142:0:14331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787857267.491548:0:14309:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787857267.491561:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787857267.508302:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+5:14296:x1874703885092992:12345-0@lo:253:mount.lustre.0 Request processed in 20053us (20710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.508321:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857267.511750:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885092992:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787857267.511770:0:14296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787857267.511774:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787857267.511776:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787857267.511777:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857267.511779:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857267.511780:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857267.511782:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857267.511783:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787857267.511785:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787857267.511786:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857267.511788:0:14296:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787857267.511814:0:14296:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd96dd97000 from lustre-MDT0000 10000000:01000000:2.0:1787857267.511844:0:14296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787857267.511848:0:14296:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787857267.511852:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fd8412333a0 10000000:01000000:2.0:1787857267.511855:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787857267.511862:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fd8412333a0 from 1 10000000:01000000:2.0:1787857267.511865:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787857267.511902:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.511923:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.511933:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857267.511954:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787857267.512012:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857267.512072:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945b7d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857267.512829:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093120 00000100:00100000:3.0:1787857267.512837:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093120 00000100:00100000:3.0:1787857267.512888:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857267.512898:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+5:14296:x1874703885093120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857267.512923:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857267.512948:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940030400/0xf326646fe3bbf7e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf7e0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.512972:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940030400/0xf326646fe3bbf7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf7e0 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.512983:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940030400/0xf326646fe3bbf7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf7e0 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.512991:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940030400, rc 0) 00000100:00100000:3.0:1787857267.513050:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+6:14296:x1874703885093120:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.513057:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787857267.513133:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.513151:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.513161:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.513235:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.513269:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.513313:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.513538:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093248 00000100:00100000:0.0:1787857267.513543:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093248 00000100:00100000:0.0:1787857267.513577:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857267.513594:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+6:14296:x1874703885093248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857267.513840:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+6:14296:x1874703885093248:12345-0@lo:501:mount.lustre.0 Request processed in 246us (569us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857267.513848:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787857267.513903:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093248:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787857267.513951:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787857267.513985:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.513995:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857267.514002:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd96dd97000 10000000:01000000:1.0:1787857267.514007:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787857267.514011:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fd96dd97000 10000000:01000000:1.0:1787857267.514013:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787857267.514016:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fd96dd97000 from 1 10000000:01000000:1.0:1787857267.514019:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787857267.514039:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514046:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514054:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.514066:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787857267.514093:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.514123:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787857267.514246:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093376 00000100:00100000:2.0:1787857267.514251:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093376 00000100:00100000:2.0:1787857267.514292:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857267.514300:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+6:14296:x1874703885093376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787857267.514308:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857267.514321:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97fa85a00/0xf326646fe3bbf7f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf7ee expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.514338:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97fa85a00/0xf326646fe3bbf7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf7ee expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.514348:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97fa85a00/0xf326646fe3bbf7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf7ee expref: 7 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.514357:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85a00, rc 0) 00000100:00100000:2.0:1787857267.514395:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+7:14296:x1874703885093376:12345-0@lo:101:mount.lustre.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.514401:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787857267.514737:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.514753:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7f5 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514773:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf7f5 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857267.514786:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787857267.514798:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7f5 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514805:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97f979200/0xf326646fe3bbf7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7f5 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857267.514811:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787857267.514814:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787857267.514819:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fd96dd97000 10000000:01000000:1.0:1787857267.514821:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787857267.514824:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787857267.514827:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787857267.514844:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514851:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.514858:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.514872:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787857267.514902:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.514930:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.515152:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093504 00000100:00100000:0.0:1787857267.515157:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093504 00000100:00100000:0.0:1787857267.515195:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787857267.515203:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+7:14296:x1874703885093504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787857267.515212:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857267.515225:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd975560000/0xf326646fe3bbf803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf7fc expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.515244:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd975560000/0xf326646fe3bbf803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf7fc expref: 8 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.515253:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd975560000/0xf326646fe3bbf803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf7fc expref: 8 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.515260:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd975560000, rc 0) 00000100:00100000:0.0:1787857267.515305:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+8:14296:x1874703885093504:12345-0@lo:101:mount.lustre.0 Request processed in 103us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.515311:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857267.515495:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.515506:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf803 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.515515:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf803 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.515577:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.515607:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.515756:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093632 00000100:00100000:0.0:1787857267.515760:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093632 00000100:00100000:1.0:1787857267.515864:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.516210:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857267.516232:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+8:14296:x1874703885093632:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857267.516707:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14296:x1874703885093632:12345-0@lo:501:mount.lustre.0 Request processed in 476us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.516716:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787857267.516812:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.516847:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787857267.516889:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.522100:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857267.522817:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093760 00000100:00100000:3.0:1787857267.522828:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093760 00000100:00100000:3.0:1787857267.522891:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787857267.522901:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14296:x1874703885093760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857267.523631:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14296:x1874703885093760:12345-0@lo:503:mount.lustre.0 Request processed in 729us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.523640:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857267.524297:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885093760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857267.526094:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14332:1874703885093888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857267.526194:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857267.526241:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96d999180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857267.526303:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885093888 00000100:00100000:2.0:1787857267.526310:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885093888 00000100:00100000:2.0:1787857267.526361:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787857267.526370:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14332:x1874703885093888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857267.526754:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14332:x1874703885093888:12345-0@lo:502:llog_process_th.0 Request processed in 383us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.526764:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787857267.526973:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14332:1874703885093888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787857267.527004:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857267.527017:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857267.527020:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787857267.527026:0:14332:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787857267.527035:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787857267.527048:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fd96d9b33a0) 00000020:00000080:3.0:1787857267.527067:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787857267.527072:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787857267.527152:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787857267.527159:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf811 00000020:00000080:3.0:1787857267.527384:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787857267.527389:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857267.527393:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857267.527394:0:14332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787857267.527397:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857267.527401:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857267.527402:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787857267.527405:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787857267.527412:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fd96d9b19d0) 00000020:00000080:3.0:1787857267.527421:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787857267.527425:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787857267.527427:0:14332:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787857267.527429:0:14332:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787857267.527434:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787857267.527470:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd96dd97000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787857267.527490:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fd9756f19d0) 00000020:00000080:3.0:1787857267.527502:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787857267.527551:0:14332:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787857267.527558:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbf826 00000020:00000080:3.0:1787857267.527652:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787857267.527703:0:14332:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787857267.527710:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf326646fe3bbf82d 00080000:01000000:3.0:1787857267.527716:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787857267.527720:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf834 00010000:00010000:2.0:1787857267.593378:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787857267.593982:0:14332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787857267.594176:0:14332:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787857267.595764:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fd9756f0000) 00000020:00000080:3.0:1787857267.595789:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787857267.595871:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787857267.595884:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf842 00000020:00000080:0.0:1787857267.596461:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787857267.602922:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf326646fe3bbf849 00000020:00000080:0.0:1787857267.603332:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787857267.603342:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.603354:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.603356:0:14332:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787857267.603360:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787857267.603363:0:14332:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787857267.603365:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787857267.603366:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787857267.603368:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787857267.603370:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.603371:0:14332:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787857267.603374:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857267.603379:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.603380:0:14332:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787857267.603385:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787857267.603420:0:14332:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787857267.603431:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.603435:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.603436:0:14332:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787857267.603439:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787857267.603442:0:14332:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787857267.603445:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.603446:0:14332:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787857267.603449:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787857267.603454:0:14332:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:0.0:1787857267.603479:0:14332:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787857267.603482:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787857267.603498:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fd96d8c4d70) 00000020:00000080:0.0:1787857267.603512:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787857267.603517:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787857267.603566:0:14332:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787857267.603571:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787857267.603576:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf857 00010000:00080000:0.0:1787857267.603619:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd960295000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1787857267.603879:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787857267.604197:0:14332:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787857267.604235:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787857267.605395:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857267.605455:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787857267.605524:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787857267.606520:0:14336:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787857267.606527:0:14336:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787857267.607419:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857267.607432:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787857267.607465:0:14332:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787857267.607483:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbf85e 00000100:00080000:0.0:1787857267.607494:0:14332:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787857267.607500:0:14332:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fd960295000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857267.607533:0:14332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb5a580 x1874703885094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787857267.607613:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885094016:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787857267.607709:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703885094016 offset 0 length 520: 4 00000100:00080000:0.0:1787857267.607962:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787857267.608059:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.608063:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.608066:0:14332:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787857267.608069:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787857267.608072:0:14332:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787857267.608073:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787857267.608075:0:14332:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787857267.608076:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787857267.608079:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.608080:0:14332:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787857267.608083:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787857267.608086:0:14332:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787857267.608089:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.608090:0:14332:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787857267.608094:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787857267.608097:0:14332:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.129@tcp to nid 0x20000c0a8cc81 (192.168.204.129@tcp) 00000020:01000000:0.0:1787857267.608119:0:14332:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787857267.608121:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787857267.608141:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fd96d8c33a0) 00000020:00000080:0.0:1787857267.608152:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787857267.608157:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787857267.608211:0:14332:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787857267.608216:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787857267.608221:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf326646fe3bbf86c 00010000:00080000:0.0:1787857267.608248:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd96db87000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1787857267.608433:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787857267.610818:0:14332:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787857267.610854:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787857267.611403:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857267.611460:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787857267.611537:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787857267.612401:0:14338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787857267.612407:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787857267.618746:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787857267.618761:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787857267.618801:0:14332:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787857267.618820:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbf873 00000100:00080000:0.0:1787857267.618831:0:14332:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787857267.618837:0:14332:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96db87000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857267.618873:0:14332:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb592c0 x1874703885094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787857267.618893:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787857267.618960:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.618964:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.618966:0:14332:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787857267.618969:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857267.618973:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.618974:0:14332:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787857267.618977:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787857267.618979:0:14332:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787857267.618981:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.618989:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.618991:0:14332:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787857267.618994:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857267.618996:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.618998:0:14332:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787857267.619001:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787857267.619030:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14332:1874703885094272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857267.619106:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.619138:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857267.619302:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094272 00000100:00100000:3.0:1787857267.619309:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094272 00000100:00100000:3.0:1787857267.619349:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787857267.619359:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14332:x1874703885094272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857267.619610:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14332:x1874703885094272:12345-0@lo:502:llog_process_th.0 Request processed in 252us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.619618:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857267.620464:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14332:1874703885094272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787857267.620498:0:14332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857267.620505:0:14332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857267.620507:0:14332:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787857267.620511:0:14332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787857267.620852:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787857267.620870:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787857267.620887:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf803 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.620898:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97f978400/0xf326646fe3bbf7fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf803 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857267.620907:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96dd97000 from 1 10000000:01000000:3.0:1787857267.620920:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787857267.620957:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.620965:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857267.620974:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857267.620992:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787857267.621037:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857267.621091:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96d9999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857267.621148:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094400 00000100:00100000:1.0:1787857267.621153:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094400 00000100:00100000:1.0:1787857267.621195:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857267.621205:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+9:14296:x1874703885094400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.621218:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857267.621232:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf87a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.621255:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.621276:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.621284:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979000, rc 0) 00000100:00100000:1.0:1787857267.621336:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+10:14296:x1874703885094400:12345-0@lo:101:mount.lustre.0 Request processed in 134us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.621343:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857267.621379:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.621391:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.621399:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.621926:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094528:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787857267.621968:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.621994:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857267.622011:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094528 00000100:00100000:1.0:1787857267.622015:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094528 00000100:00100000:1.0:1787857267.622037:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857267.622043:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+10:14296:x1874703885094528:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787857267.622073:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787857267.622079:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787857267.622145:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+10:14296:x1874703885094528:12345-0@lo:256:mount.lustre.0 Request processed in 101us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.622152:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787857267.622191:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094528:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787857267.622775:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787857267.622785:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.622794:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857267.622802:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96dd97000 from 1 10000000:01000000:1.0:1787857267.622804:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787857267.622828:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.622835:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.622844:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.622859:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787857267.622893:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.622934:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857267.622954:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094656 00000100:00100000:1.0:1787857267.622958:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094656 00000100:00100000:1.0:1787857267.622987:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787857267.622994:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+10:14296:x1874703885094656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.623004:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857267.623015:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf888 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.623047:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.623057:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.623066:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979600, rc 0) 00000100:00100000:1.0:1787857267.623097:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885094656:12345-0@lo:101:mount.lustre.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.623104:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787857267.623139:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094656:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857267.623149:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.623157:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.623200:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.623225:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.623238:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857267.623251:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094784 00000100:00100000:1.0:1787857267.623254:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094784 00000100:00100000:1.0:1787857267.623271:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857267.623291:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885094784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.623702:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885094784:12345-0@lo:501:mount.lustre.0 Request processed in 425us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.623718:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857267.623757:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857267.623792:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787857267.623834:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.623856:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9456bae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857267.623868:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885094912 00000100:00100000:1.0:1787857267.623872:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885094912 00000100:00100000:1.0:1787857267.623890:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857267.623895:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885094912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857267.624272:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885094144:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787857267.624304:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703885094144 offset 0 length 520: 4 00000100:00100000:1.0:1787857267.628760:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885094912:12345-0@lo:503:mount.lustre.0 Request processed in 4852us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857267.628775:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787857267.629426:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885094912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857267.631981:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14340:1874703885095040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857267.632072:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857267.632128:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.632192:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095040 00000100:00100000:0.0:1787857267.632199:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095040 00000100:00100000:0.0:1787857267.632246:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787857267.632255:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14340:x1874703885095040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857267.632525:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14340:x1874703885095040:12345-0@lo:502:llog_process_th.0 Request processed in 270us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.632533:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787857267.632656:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14340:1874703885095040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787857267.632728:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857267.632738:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.632740:0:14340:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787857267.632748:0:14340:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96dd97000 00000020:00000080:2.0:1787857267.632750:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787857267.632758:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857267.632760:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.632761:0:14340:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787857267.632764:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857267.632765:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.632767:0:14340:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787857267.632770:0:14340:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96dd97000 00000020:00000080:2.0:1787857267.632772:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787857267.632827:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857267.632830:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.632832:0:14340:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787857267.632841:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787857267.632844:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.632846:0:14340:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787857267.632850:0:14340:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd96dd97000 00000020:00000080:2.0:1787857267.632852:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787857267.632888:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14340:1874703885095168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857267.632936:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857267.632956:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97f9ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1787857267.633030:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095168 00000100:00100000:3.0:1787857267.633035:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095168 00000100:00100000:3.0:1787857267.633065:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787857267.633072:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14340:x1874703885095168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857267.633208:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14340:x1874703885095168:12345-0@lo:502:llog_process_th.0 Request processed in 136us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.633215:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787857267.638870:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14340:1874703885095168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787857267.638932:0:14340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787857267.638941:0:14340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857267.638944:0:14340:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787857267.638948:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787857267.639163:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787857267.639183:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787857267.639203:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.639216:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857267.639277:0:14296:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787857267.639281:0:14296:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd96dd97000 10000000:01000000:0.0:1787857267.639284:0:14296:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd96dd97000 10000000:01000000:0.0:1787857267.639289:0:14296:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787857267.639295:0:14296:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96dd97000 from 1 10000000:01000000:0.0:1787857267.639298:0:14296:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787857267.639336:0:14296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.639344:0:14296:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.639353:0:14296:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857267.639374:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787857267.639438:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.639483:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857267.639531:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095296 00000100:00100000:2.0:1787857267.639538:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095296 00000100:00100000:2.0:1787857267.639598:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787857267.639615:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885095296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787857267.639629:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857267.639642:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97fa85600/0xf326646fe3bbf89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf896 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.639694:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97fa85600/0xf326646fe3bbf89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf896 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.639705:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97fa85600/0xf326646fe3bbf89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf896 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857267.639713:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85600, rc 0) 00000100:00100000:2.0:1787857267.639748:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885095296:12345-0@lo:101:mount.lustre.0 Request processed in 142us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.639761:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787857267.639954:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787857267.639969:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf89d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.639978:0:14296:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf89d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857267.640022:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857267.640047:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.640078:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857267.640242:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095424 00000100:00100000:2.0:1787857267.640247:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095424 00000100:00100000:2.0:1787857267.640276:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787857267.640282:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885095424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857267.640536:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885095424:12345-0@lo:501:mount.lustre.0 Request processed in 254us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.640544:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787857267.640816:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857267.640848:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095552:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787857267.640889:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.640930:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857267.640973:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095552 00000100:00100000:3.0:1787857267.640978:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095552 00000100:00100000:3.0:1787857267.641004:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787857267.641011:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885095552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857267.641161:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885095552:12345-0@lo:503:mount.lustre.0 Request processed in 149us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.641168:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787857267.641271:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885095552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857267.641605:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f07c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14342:1874703885095680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787857267.641835:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857267.641866:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96d999480 going to sleep for 11 seconds 00000100:00100000:2.0:1787857267.641917:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095680 00000100:00100000:2.0:1787857267.641923:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095680 00000100:00100000:2.0:1787857267.641957:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787857267.641964:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14342:x1874703885095680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787857267.642156:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14342:x1874703885095680:12345-0@lo:502:llog_process_th.0 Request processed in 192us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857267.642163:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787857267.642234:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f07c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14342:1874703885095680:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787857267.642289:0:14342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787857267.642304:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fd96d8c19d0) 00000020:00000080:0.0:1787857267.642323:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787857267.642398:0:14342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd96dd97000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787857267.642402:0:14342:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd96dd97000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787857267.642405:0:14342:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd96dd97000 4 00010000:00080000:0.0:1787857267.642442:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd968791000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.129@tcp at head 00010000:00010000:0.0:1787857267.644223:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787857267.644440:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787857267.644476:0:14342:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787857267.644492:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf326646fe3bbf8ab 00000100:00080000:0.0:1787857267.644503:0:14342:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787857267.644510:0:14342:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fd968791000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:0.0:1787857267.644545:0:14342:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd97bb5a940 x1874703885095808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787857267.644577:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787857267.644887:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885095808:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787857267.644970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.650456:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095808 00000100:00100000:0.0:1787857267.650470:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095808 00000100:00100000:0.0:1787857267.650517:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857267.650525:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885095808:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787857267.652299:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874703885095808:12345-0@lo:38:llog_process_th.0 Request processed in 1767us (7322us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787857267.652312:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857267.652431:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14342:1874703885095936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857267.652486:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.652513:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885095936 00000100:00100000:0.0:1787857267.652520:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885095936 00000100:00100000:0.0:1787857267.652554:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857267.652562:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14342:x1874703885095936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787857267.652817:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14342:x1874703885095936:12345-0@lo:502:llog_process_th.0 Request processed in 255us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.652824:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787857267.652872:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.652892:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64833f6a-f420-4926-9238-fdfd3153a5b1:14342:1874703885095936:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787857267.652927:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787857267.652981:0:14296:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787857267.653002:0:14296:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857267.653017:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf89d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.653027:0:14296:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975561800/0xf326646fe3bbf896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf89d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787857267.653070:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787857267.653072:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857267.653073:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857267.653075:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857267.653084:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857267.653086:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857267.653087:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857267.653088:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857267.653090:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857267.653091:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857267.653094:0:14296:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787857267.653097:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787857267.653098:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857267.653098:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857267.653099:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857267.653100:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857267.653101:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857267.653102:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857267.653102:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857267.653103:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857267.653104:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857267.653116:0:14296:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787857267.653125:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885096064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787857267.653153:0:14296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.653169:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd8432c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.653192:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096064 00000100:00100000:0.0:1787857267.653196:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096064 00000100:00100000:0.0:1787857267.653219:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857267.653225:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14296:x1874703885096064:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787857267.653252:0:14309:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787857267.653265:0:14309:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787857267.662812:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787857267.662826:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd968791000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787857267.662835:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787857267.662840:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885095808:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1787857267.730884:0:14309:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787857267.730905:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787857267.732316:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787857267.732325:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787857267.732352:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.732375:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.732385:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.732432:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857267.732448:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 12 pid: 14309 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857267.732483:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885096192:0@lo:104: 00000100:00100000:1.0:1787857267.732566:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857267.732723:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9505363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857267.733310:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096192 00000100:00100000:0.0:1787857267.733319:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096192 00000100:00100000:0.0:1787857267.733365:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857267.733374:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885096192:12345-0@lo:104: 00010000:00010000:0.0:1787857267.733389:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733465:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857267.733471:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885096192:12345-0@lo:104: Request processed in 99us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.733479:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787857267.733503:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857267.733509:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733515:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031200 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857267.733520:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733528:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857267.733535:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857267.733541:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857267.733572:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733580:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857267.733600:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733620:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940031200/0xf326646fe3bbf87a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf881 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733649:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857267.733651:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857267.733653:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857267.733700:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885096320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857267.733733:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857267.733799:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096320 00000100:00100000:0.0:1787857267.733803:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096320 00010000:00010000:0.0:1787857267.733821:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 13 pid: 14309 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857267.733842:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857267.733849:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+13:3311:x1874703885096320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857267.733861:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857267.733867:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 13 pid: 14309 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733878:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 13 pid: 14309 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733897:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733905:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787857267.733932:0:14299:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001606239s 00010000:00010000:0.0:1787857267.733936:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733953:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733960:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733965:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733970:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857267.733973:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733980:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733989:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.733998:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857267.734027:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+13:3311:x1874703885096320:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857267.734034:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857267.734102:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885096320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857267.734129:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f979000/0xf326646fe3bbf881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf87a expref: 12 pid: 14309 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857267.734138:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885096192:0@lo:104: 00010000:00010000:0.0:1787857267.734154:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.734167:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.734173:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857267.734179:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f978000/0xf326646fe3bbf8b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857267.738428:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14296:x1874703885096064:12345-0@lo:253:mount.lustre.0 Request processed in 85193us (85264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857267.738442:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787857267.738570:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14296:1874703885096064:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787857267.738598:0:14296:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787857267.738603:0:14296:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787857267.738604:0:14296:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787857267.738615:0:14296:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857267.738617:0:14296:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857267.738618:0:14296:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857267.738619:0:14296:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857267.738620:0:14296:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787857267.738622:0:14296:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787857267.738624:0:14296:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857267.738626:0:14296:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787857267.738639:0:14296:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787857267.744799:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.745350:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787857267.746037:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.746199:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787857267.746562:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.747143:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787857267.748131:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.748293:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787857267.748552:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.748811:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787857267.749054:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787857267.749201:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787857267.778371:0:14296:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787857267.779016:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787857267.779152:0:14352:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787857267.779157:0:14352:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787857267.779462:0:14353:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787857267.779538:0:14353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857267.783703:0:14353:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787857267.783786:0:14353:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787857267.783791:0:14353:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787857267.785633:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787857267.785809:0:14296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787857267.787497:0:14296:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787857267.787577:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787857267.787847:0:14296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857267.794408:0:14296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787857267.796616:0:14296:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787857267.796711:0:14296:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787857267.803749:0:14296:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787857267.816569:0:14296:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787857267.864079:0:14296:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787857267.864118:0:14296:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc032c1c5b988 00100000:10000000:0.0:1787857267.864127:0:14296:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787857267.864714:0:14296:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787857267.864729:0:14296:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787857267.864744:0:14296:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787857267.864772:0:14296:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787857268.431433:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857268.748793:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787857268.873413:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787857268.873424:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96dd97000 from 6 10000000:01000000:2.0:1787857268.873430:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787857268.873487:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857268.873503:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857268.873517:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857268.873544:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885096448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857268.874040:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857268.874153:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd944e58900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857268.874574:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096448 00000100:00100000:3.0:1787857268.874585:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096448 00000100:00100000:3.0:1787857268.874740:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787857268.874749:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14311:x1874703885096448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857268.874765:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857268.874788:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf8b9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857268.874817:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857268.874827:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857268.874837:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940030e00, rc 0) 00000100:00100000:3.0:1787857268.874982:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885096448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857268.874990:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857268.875369:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885096448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857268.875390:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857268.875401:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857268.875462:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885096576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787857268.875502:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857268.875531:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd944e58900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857268.875644:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096576 00000100:00100000:0.0:1787857268.875650:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096576 00000100:00100000:0.0:1787857268.875711:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787857268.875720:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885096576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787857268.875737:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787857268.875755:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787857268.875758:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787857268.875837:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885096576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857268.875844:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787857268.876112:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885096576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787857268.876156:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787857268.876165:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857268.876179:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857269.448856:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787857269.768542:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787857270.471777:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857271.496914:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787857272.269611:0:14596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787857272.524391:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787857272.647918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857272.647924:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787857272.647927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857272.647930:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787857272.647933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787857272.647936:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787857272.647940:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd968791000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787857272.647953:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fd968791000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857272.647980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd843e3a580 x1874703885096832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787857272.648046:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885096832:0@lo:38:kworker.0 00000100:00100000:0.0:1787857272.648072:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885096704:0@lo:400:kworker.0 00000100:00100000:0.0:1787857272.649330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857272.649456:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096704 00000100:00100000:2.0:1787857272.649465:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096704 00000100:00100000:2.0:1787857272.649514:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857272.649522:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:3312:x1874703885096704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857272.649579:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:3312:x1874703885096704:12345-0@lo:400:kworker.0 Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857272.649586:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787857272.649626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857272.649627:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885096704:0@lo:400:kworker.0 00000100:00100000:2.0:1787857272.649770:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096832 00000100:00100000:2.0:1787857272.649775:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096832 00000100:00100000:2.0:1787857272.649802:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857272.649807:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874703885096832:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787857272.649839:0:14316:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1787857272.649872:0:14316:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf326646fe3bbf8c7 00000004:00100000:2.0:1787857272.649887:0:14316:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787857272.650016:0:14316:0:(import.c:65:import_set_state_nolock()) ffff9fd9602a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857272.650067:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874703885096832:12345-0@lo:38:kworker.0 Request processed in 258us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857272.650074:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787857272.652351:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd843e3a580 x1874703885096832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787857272.652373:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787857272.652381:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787857272.652386:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787857272.652390:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd968791000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787857272.652397:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874703885096832:0@lo:38:kworker.0 00010000:00010000:1.0:1787857273.547946:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857274.568188:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787857274.989604:0:14746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff66e778d0 20000000:00000080:2.0:1787857274.989624:0:14746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd9759f1800 uarg=0000000000000000 20000000:01000000:2.0:1787857274.989888:0:14746:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787857274.989895:0:14746:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787857274.989899:0:14746:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787857274.996533:0:14747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787857274.996892:0:14746:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787857275.010502:0:14746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787857275.010604:0:14746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.010624:0:14746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.010648:0:14746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.010721:0:14746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.010737:0:14746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 11 pid: 14309 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857275.010752:0:14746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14746:1874703885096960:0@lo:104: 00000100:00100000:3.0:1787857275.010826:0:14746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857275.010873:0:14746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9467c26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857275.010972:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885096960 00000100:00100000:0.0:1787857275.010979:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885096960 00000100:00100000:0.0:1787857275.011027:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857275.011036:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14746:x1874703885096960:12345-0@lo:104: 00010000:00010000:0.0:1787857275.011054:0:14298:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857275.011126:0:14298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857275.011132:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14746:x1874703885096960:12345-0@lo:104: Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857275.011139:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787857275.011153:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857275.011161:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857275.011170:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979e00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857275.011175:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857275.011191:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857275.011199:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857275.011206:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787857275.011238:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857275.011245:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857275.011277:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857275.011284:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd97f979e00/0xf326646fe3bbf888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf88f expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857275.011298:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857275.011300:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857275.011302:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857275.011331:0:14746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14746:1874703885096960:0@lo:104: 00010000:00010000:1.0:1787857275.011361:0:14746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857275.011496:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787857275.011507:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885097088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787857275.011539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857275.011579:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097088 00000100:00100000:3.0:1787857275.011583:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097088 00010000:00010000:3.0:1787857275.011608:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 12 pid: 14309 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857275.011633:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857275.011640:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:3310:x1874703885097088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857275.011651:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857275.011656:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 12 pid: 14309 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011690:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 12 pid: 14309 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011717:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f979600/0xf326646fe3bbf88f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf888 expref: 12 pid: 14309 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011730:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011739:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011752:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011759:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011775:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011782:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011787:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857275.011791:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011799:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011821:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857275.011839:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787857275.011876:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+11:3310:x1874703885097088:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857275.011883:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787857275.012747:0:14746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857275.012759:0:14746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857275.012774:0:14746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031600/0xf326646fe3bbf8ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857275.014350:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885097088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857275.592401:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787857276.423810:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857276.423818:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96dd97000 from 10 10000000:01000000:2.0:1787857276.423824:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857276.423877:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857276.423891:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857276.423928:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857276.423960:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857276.424041:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857276.424118:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd97fa06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857276.424402:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097216 00000100:00100000:3.0:1787857276.424411:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097216 00000100:00100000:3.0:1787857276.424461:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787857276.424471:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+11:14311:x1874703885097216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857276.424486:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857276.424500:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf8d5 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857276.424522:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857276.424533:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857276.424541:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031200, rc 0) 00000100:00100000:3.0:1787857276.424893:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885097216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857276.424901:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787857276.427352:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857276.428352:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857276.428372:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857276.428563:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857276.428631:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857276.428777:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9602f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857276.431095:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097344 00000100:00100000:2.0:1787857276.431109:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097344 00000100:00100000:2.0:1787857276.431250:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787857276.431260:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885097344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857276.431775:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885097344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 515us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857276.431785:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787857276.431795:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857276.431849:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857276.431908:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857276.431948:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9602f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857276.432012:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097472 00000100:00100000:3.0:1787857276.432017:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097472 00000100:00100000:3.0:1787857276.432051:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787857276.432069:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885097472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857276.432254:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14311:x1874703885097472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857276.432278:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787857276.432393:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885097472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787857276.433387:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787857276.433575:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787857276.433594:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787857276.433605:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857276.433618:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857276.617307:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857277.645418:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787857277.768351:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787857277.768359:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787857277.768361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787857277.768365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787857277.768395:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787857277.768415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885097600:0@lo:400:kworker.0 00000100:00100000:0.0:1787857277.768488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857277.768543:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857277.768552:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885097728:0@lo:400:kworker.0 00000100:00100000:0.0:1787857277.768592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857277.768628:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097600 00000100:00100000:0.0:1787857277.768635:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097600 00000100:00100000:0.0:1787857277.768723:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787857277.768734:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:3309:x1874703885097600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857277.768786:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+12:3309:x1874703885097600:12345-0@lo:400:kworker.0 Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857277.768794:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787857277.768826:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885097728 00000100:00100000:0.0:1787857277.768830:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885097728 00000100:00100000:0.0:1787857277.768858:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857277.768865:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885097728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857277.768901:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885097728:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857277.768924:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787857277.768970:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd97bb583c0 x1874703885097728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857277.768988:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885097728:0@lo:400:kworker.0 00000100:00100000:0.0:1787857277.769018:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885097600:0@lo:400:kworker.0 00000100:00100000:2.0:1787857277.772098:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787857267/real 1787857267] req@ffff9fd97bb592c0 x1874703885094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857277 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857277.772125:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fd97bb592c0 x1874703885094144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857277 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857277.772134:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787857267/real 1787857267] req@ffff9fd97bb5a580 x1874703885094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857277 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787857277.772144:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fd97bb5a580 x1874703885094016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857277 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787857277.772177:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787857277.772193:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787857277.772197:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885094144:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787857277.772203:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd960295000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787857277.772208:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787857277.772211:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885094016:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787857277.772280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857277.772284:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787857277.772287:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fd960295000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787857277.772291:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1787857277.772296:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787857277.772303:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fd960295000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857277.772333:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd843e3b840 x1874703885097856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787857277.772349:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857277.772352:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787857277.772354:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787857277.772357:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1787857277.772360:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787857277.772363:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96db87000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857277.772375:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd843e38000 x1874703885097984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787857277.772401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885097856:0@lo:8:kworker.0 00000400:00000100:2.0:1787857277.772449:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703885097856 offset 0 length 520: 4 00000100:00100000:2.0:1787857277.772482:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885097984:0@lo:8:kworker.0 00000400:00000100:2.0:1787857277.772499:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874703885097984 offset 0 length 520: 4 00010000:00010000:0.0:1787857278.665312:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857279.691597:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787857279.833051:0:14995:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787857279.833068:0:14995:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787857279.833187:0:14995:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fd96b886000 00000020:01000004:1.0:1787857279.833205:0:14995:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787857279.833218:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787857279.833232:0:14995:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fd841230000) 00000020:00000080:1.0:1787857279.833247:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787857279.862408:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787857279.863577:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787857279.865968:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787857279.868201:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787857279.868862:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787857279.869528:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1787857279.869778:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1787857279.869874:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1787857279.870339:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:1.0:1787857279.871119:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 588: rc = 0 00100000:10000000:1.0:1787857279.871629:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 588: rc = 0 00100000:10000000:2.0:1787857279.873284:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00100000:10000000:2.0:1787857279.873789:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:2.0:1787857279.874067:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 588: rc = 0 00000020:00000080:2.0:1787857279.875039:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787857279.875051:0:14995:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787857279.875063:0:14995:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf326646fe3bbf8ea 00000020:01000004:2.0:1787857279.875072:0:14995:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787857279.875092:0:14995:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787857279.875097:0:14995:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787857279.875103:0:14995:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787857279.875107:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787857279.875119:0:14995:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fd96db8cd70) 00000020:00000080:2.0:1787857279.875128:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787857279.876292:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857279.876606:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787857279.876613:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787857279.877498:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787857279.877507:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787857279.878007:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787857279.878015:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787857279.883565:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787857279.883971:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787857279.883978:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787857279.884783:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787857279.884792:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787857279.907783:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857279.908021:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787857279.908028:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787857279.910276:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787857279.910291:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787857279.912791:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787857279.912805:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787857279.916040:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787857279.916331:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787857279.916337:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787857279.917466:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787857279.917476:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787857279.971468:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787857279.971782:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787857279.971789:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787857279.973692:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787857279.973711:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787857279.975557:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787857279.975584:0:14995:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787857279.975590:0:14995:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787857280.001088:0:14995:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787857280.001127:0:14995:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.129@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787857280.001132:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787857280.001134:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857280.001139:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857280.001140:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857280.001142:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857280.001144:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857280.001145:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857280.001147:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857280.001148:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787857280.001151:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787857280.001154:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787857280.001155:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857280.001156:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857280.001157:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857280.001158:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857280.001159:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857280.001160:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857280.001161:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857280.001162:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787857280.001198:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787857280.001218:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787857280.001286:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.001397:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857280.002196:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098112 00000100:00100000:0.0:1787857280.002205:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098112 00000100:00100000:0.0:1787857280.002301:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787857280.002312:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14995:x1874703885098112:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787857280.002344:0:14307:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787857280.002356:0:14307:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787857280.002360:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000040:00080000:3.0:1787857280.008810:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787857280.014185:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14995:x1874703885098112:12345-0@lo:253:mount.lustre.0 Request processed in 11856us (12879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.014200:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787857280.014399:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787857280.014417:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787857280.014421:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787857280.014423:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787857280.014424:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857280.014426:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857280.014428:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857280.014429:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857280.014431:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857280.014433:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857280.014435:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787857280.014455:0:14995:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd96b886000 from lustre-OST0000 10000000:01000000:2.0:1787857280.014485:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787857280.014488:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787857280.014496:0:14995:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fd8412333a0 local copy 00010000:00010000:2.0:1787857280.014507:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857280.014966:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857280.015009:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.015098:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857280.015137:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098240 00000100:00100000:3.0:1787857280.015144:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098240 00000100:00100000:3.0:1787857280.015329:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787857280.015340:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14995:x1874703885098240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857280.015517:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14995:x1874703885098240:12345-0@lo:501:mount.lustre.0 Request processed in 179us (507us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857280.015531:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787857280.015607:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098240:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787857280.015622:0:14995:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787857280.016092:0:14995:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787857280.016102:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016113:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857280.016134:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd96b886000 10000000:01000000:0.0:1787857280.016138:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787857280.016142:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fd8412333a0 10000000:01000000:0.0:1787857280.016145:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787857280.016149:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fd8412333a0 from 1 10000000:01000000:0.0:1787857280.016152:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787857280.016295:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016305:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016316:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857280.016334:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787857280.016372:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857280.016446:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945485180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.016494:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098368 00000100:00100000:1.0:1787857280.016500:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098368 00000100:00100000:1.0:1787857280.016572:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787857280.016581:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+12:14995:x1874703885098368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857280.016592:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857280.016606:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97f978200/0xf326646fe3bbf8ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf8f8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.016626:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f978200/0xf326646fe3bbf8ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf8f8 expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.016636:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97f978200/0xf326646fe3bbf8ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf8f8 expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.016645:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978200, rc 0) 00000100:00100000:1.0:1787857280.016726:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+13:14995:x1874703885098368:12345-0@lo:101:mount.lustre.0 Request processed in 145us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.016742:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787857280.016807:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787857280.016820:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8ff expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016829:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf8ff expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857280.016846:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787857280.016862:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8ff expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016870:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975560800/0xf326646fe3bbf8f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf8ff expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857280.016876:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787857280.016880:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787857280.016884:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787857280.016886:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787857280.016900:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016907:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.016913:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857280.016925:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787857280.016952:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857280.017150:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945485180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.017318:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098496 00000100:00100000:2.0:1787857280.017323:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098496 00000100:00100000:2.0:1787857280.017348:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787857280.017355:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+13:14995:x1874703885098496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787857280.017363:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857280.017374:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97fa84a00/0xf326646fe3bbf90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf906 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.017389:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97fa84a00/0xf326646fe3bbf90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf906 expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.017398:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97fa84a00/0xf326646fe3bbf90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf906 expref: 14 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.017405:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84a00, rc 0) 00000100:00100000:2.0:1787857280.017481:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098496:12345-0@lo:101:mount.lustre.0 Request processed in 125us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857280.017487:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787857280.017594:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787857280.017605:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf90d expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.017613:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf90d expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857280.018523:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787857280.019904:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787857280.020162:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787857280.020350:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787857280.020386:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787857280.020436:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787857280.020472:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787857280.020504:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787857280.020579:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787857280.020588:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787857280.020804:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857280.020874:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857280.020910:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9612aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.020984:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098624 00000100:00100000:2.0:1787857280.020991:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098624 00000100:00100000:2.0:1787857280.021036:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787857280.021045:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857280.021549:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098624:12345-0@lo:501:mount.lustre.0 Request processed in 504us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857280.021566:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787857280.021947:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857280.022080:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857280.022128:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.022205:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787857280.022357:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098752 00000100:00100000:3.0:1787857280.022363:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098752 00000100:00100000:3.0:1787857280.022438:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787857280.022446:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857280.022944:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098752:12345-0@lo:503:mount.lustre.0 Request processed in 497us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857280.022952:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787857280.023060:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098752:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787857280.024061:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787857280.024143:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.024391:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.024432:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857280.024505:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885098880 00000100:00100000:0.0:1787857280.024511:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885098880 00000100:00100000:0.0:1787857280.024592:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787857280.024602:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787857280.024972:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885098880:12345-0@lo:502:mount.lustre.0 Request processed in 371us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.024980:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787857280.025069:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885098880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787857280.025396:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787857280.025446:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787857280.025481:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787857280.025530:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787857280.025568:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787857280.025601:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787857280.025735:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787857280.025779:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787857280.025827:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787857280.025877:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787857280.025915:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787857280.025976:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787857280.026015:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.026070:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.026586:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.026688:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099008 00000100:00100000:1.0:1787857280.026697:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099008 00000100:00100000:1.0:1787857280.026737:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787857280.026746:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885099008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857280.026933:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885099008:12345-0@lo:502:mount.lustre.0 Request processed in 187us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.026941:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787857280.027034:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787857280.027117:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787857280.027127:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787857280.028189:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787857280.028198:0:15009:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787857280.028205:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787857280.028207:0:15009:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787857280.028212:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787857280.028336:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fd96db899d0) 00000020:00000080:2.0:1787857280.028362:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787857280.028370:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787857280.028432:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd96b886000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787857280.028440:0:15009:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787857280.028447:0:15009:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf326646fe3bbf91b 00010000:00010000:2.0:1787857280.032815:0:15009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787857280.033547:0:15009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787857280.036431:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787857280.040040:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787857280.040056:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857280.040062:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040064:0:15009:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787857280.040068:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787857280.040071:0:15009:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787857280.040073:0:15009:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787857280.040075:0:15009:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787857280.040076:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787857280.040086:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040087:0:15009:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787857280.040090:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857280.040093:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040094:0:15009:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787857280.040097:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787857280.040099:0:15009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787857280.040101:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857280.040104:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040105:0:15009:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787857280.040107:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857280.040109:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040110:0:15009:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787857280.040113:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787857280.040321:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857280.040325:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857280.040327:0:15009:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787857280.040330:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787857280.041172:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787857280.041215:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787857280.041245:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf90d expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857280.041258:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975560600/0xf326646fe3bbf906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf90d expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857280.041266:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96b886000 from 1 10000000:01000000:3.0:1787857280.041269:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787857280.041304:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857280.041312:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857280.041325:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857280.041366:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787857280.041435:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857280.041479:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.041691:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099136 00000100:00100000:1.0:1787857280.041698:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099136 00000100:00100000:1.0:1787857280.041746:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787857280.041756:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+14:14995:x1874703885099136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857280.041769:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857280.041783:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf922 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.041806:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.041816:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 15 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.041824:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978800, rc 0) 00000100:00100000:1.0:1787857280.041878:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099136:12345-0@lo:101:mount.lustre.0 Request processed in 124us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.041886:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787857280.042120:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857280.042136:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857280.042145:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857280.042732:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787857280.043234:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787857280.043476:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787857280.043520:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787857280.043580:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787857280.043588:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787857280.043653:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857280.043739:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857280.043779:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857280.046886:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099264 00000100:00100000:0.0:1787857280.046900:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099264 00000100:00100000:0.0:1787857280.046957:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787857280.046967:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857280.047292:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099264:12345-0@lo:501:mount.lustre.0 Request processed in 326us (3552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.047299:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787857280.047990:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857280.048053:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857280.048109:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.048148:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.048211:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099392 00000100:00100000:1.0:1787857280.048217:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099392 00000100:00100000:1.0:1787857280.048270:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787857280.048279:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787857280.048454:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099392:12345-0@lo:503:mount.lustre.0 Request processed in 175us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.048461:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787857280.048478:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787857280.049111:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787857280.049179:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.049222:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.049251:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.050020:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099520 00000100:00100000:1.0:1787857280.050030:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099520 00000100:00100000:1.0:1787857280.050070:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787857280.050079:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857280.050439:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099520:12345-0@lo:502:mount.lustre.0 Request processed in 360us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.050446:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787857280.050737:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787857280.050996:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787857280.051051:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787857280.051092:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787857280.051120:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787857280.051145:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787857280.051181:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787857280.051211:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787857280.051238:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787857280.051268:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.051317:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.051353:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9757cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.057074:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099648 00000100:00100000:1.0:1787857280.057090:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099648 00000100:00100000:1.0:1787857280.057148:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787857280.057157:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857280.057465:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099648:12345-0@lo:502:mount.lustre.0 Request processed in 308us (6147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.057473:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787857280.057813:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787857280.057958:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787857280.057975:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787857280.059605:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857280.059624:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.059627:0:15013:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787857280.059636:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96b886000 00000020:00000080:0.0:1787857280.059639:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787857280.059647:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857280.059650:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.059651:0:15013:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787857280.059653:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857280.059656:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.059657:0:15013:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787857280.059803:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd96b886000 00000020:00000080:0.0:1787857280.059806:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787857280.059898:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857280.059902:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.059904:0:15013:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787857280.059907:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787857280.059911:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.059912:0:15013:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787857280.059916:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd96b886000 00000020:00000080:0.0:1787857280.059918:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787857280.078654:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787857280.078694:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787857280.078697:0:15013:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787857280.078702:0:15013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787857280.079860:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787857280.079897:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857280.079919:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.079934:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857280.079989:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787857280.079992:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd96b886000 10000000:01000000:2.0:1787857280.079995:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd96b886000 10000000:01000000:2.0:1787857280.079999:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787857280.080004:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd96b886000 from 1 10000000:01000000:2.0:1787857280.080006:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787857280.080043:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.080051:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857280.080063:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857280.080101:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787857280.080176:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857280.080229:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.081807:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099776 00000100:00100000:1.0:1787857280.081817:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099776 00000100:00100000:1.0:1787857280.081865:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787857280.081880:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885099776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857280.081896:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857280.081912:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97f979a00/0xf326646fe3bbf937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf930 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.081939:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f979a00/0xf326646fe3bbf937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf930 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.081950:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97f979a00/0xf326646fe3bbf937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf930 expref: 16 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.081960:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979a00, rc 0) 00000100:00100000:1.0:1787857280.082240:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885099776:12345-0@lo:101:mount.lustre.0 Request processed in 360us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.082248:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787857280.082379:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857280.082401:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf937 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857280.082410:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf937 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857280.083098:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787857280.083434:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787857280.085942:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787857280.086031:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787857280.086062:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787857280.086103:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787857280.086139:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787857280.086214:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787857280.086255:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787857280.086288:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787857280.086338:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787857280.086372:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787857280.086403:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787857280.086446:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787857280.086488:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787857280.086518:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787857280.086577:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787857280.086615:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787857280.086647:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787857280.088755:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787857280.088815:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787857280.088846:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787857280.088889:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787857280.088939:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787857280.088973:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787857280.089032:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787857280.089070:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787857280.089112:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787857280.091299:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787857280.091390:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787857280.091484:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787857280.091493:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787857280.091611:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857280.091786:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857280.091831:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494840 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.092426:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885099904 00000100:00100000:2.0:1787857280.092434:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885099904 00000100:00100000:2.0:1787857280.092537:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787857280.092547:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885099904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857280.092838:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885099904:12345-0@lo:501:mount.lustre.0 Request processed in 292us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857280.092846:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787857280.092946:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885099904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857280.092980:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857280.093022:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857280.098944:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494840 going to sleep for 11 seconds 00000100:00100000:1.0:1787857280.098944:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100032 00000100:00100000:1.0:1787857280.098958:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100032 00000100:00100000:1.0:1787857280.099011:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787857280.099021:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787857280.099250:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100032:12345-0@lo:503:mount.lustre.0 Request processed in 229us (6226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.099257:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787857280.100132:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787857280.102270:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787857280.103123:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857280.103208:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857280.103249:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cc33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.108819:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100160 00000100:00100000:2.0:1787857280.108834:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100160 00000100:00100000:2.0:1787857280.108945:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787857280.108955:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.109291:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100160:12345-0@lo:502:mount.lustre.0 Request processed in 337us (6082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857280.109299:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787857280.110548:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787857280.110935:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787857280.111008:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787857280.111045:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787857280.111093:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787857280.111131:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787857280.111182:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787857280.111219:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787857280.111255:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787857280.111323:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787857280.111361:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787857280.111397:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787857280.111446:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787857280.111485:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787857280.111518:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787857280.111563:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787857280.111594:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787857280.111621:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787857280.111721:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787857280.111763:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787857280.111793:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787857280.111839:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787857280.111872:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787857280.111904:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787857280.111945:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787857280.111976:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787857280.112000:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787857280.112061:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787857280.112098:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787857280.112129:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787857280.112176:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787857280.112213:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787857280.112248:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787857280.112293:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787857280.112360:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787857280.112396:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787857280.112444:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787857280.112481:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787857280.112515:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787857280.112563:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787857280.112604:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787857280.112652:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857280.112762:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857280.112807:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cc33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.113158:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100288 00000100:00100000:2.0:1787857280.113167:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100288 00000100:00100000:2.0:1787857280.113349:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787857280.113359:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857280.113606:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100288:12345-0@lo:502:mount.lustre.0 Request processed in 249us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857280.113615:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787857280.115063:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787857280.115351:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787857280.115369:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787857280.122291:0:15017:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787857280.122311:0:15017:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fd9756f4d70) 00000020:00000080:3.0:1787857280.122333:0:15017:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787857280.122415:0:15017:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd96b886000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787857280.122419:0:15017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd96b886000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787857280.122434:0:15017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd96b886000 3 00010000:00080000:3.0:1787857280.122469:0:15017:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd97a625800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.129@tcp at head 00010000:00010000:3.0:1787857280.126314:0:15017:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787857280.126498:0:15017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787857280.126534:0:15017:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787857280.126545:0:15017:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf326646fe3bbf945 00000100:00080000:3.0:1787857280.126555:0:15017:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787857280.126561:0:15017:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fd97a625800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857280.126593:0:15017:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f04b40 x1874703885100416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857280.126641:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885100416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787857280.126740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787857280.126789:0:15017:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787857280.126810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787857280.126820:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787857280.126823:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787857280.126826:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787857280.126859:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857280.126866:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885100544:0@lo:400:kworker.0 00000100:00100000:3.0:1787857280.126889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857280.127138:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100416 00000100:00100000:0.0:1787857280.127145:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100416 00000100:00100000:0.0:1787857280.127167:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100544 00000100:00100000:0.0:1787857280.127169:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100544 00000100:00100000:0.0:1787857280.127190:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857280.127198:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885100544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857280.127251:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885100544:12345-0@lo:400:kworker.0 Request processed in 53us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.127258:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787857280.127278:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857280.127282:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1874703885100416:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787857280.127301:0:14315:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1787857280.127326:0:14315:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf326646fe3bbf94c 00000004:00100000:0.0:1787857280.127339:0:14315:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787857280.127364:0:14315:0:(import.c:65:import_set_state_nolock()) ffff9fd9769a9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787857280.127396:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874703885100416:12345-0@lo:38:llog_process_th.0 Request processed in 113us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.127403:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787857280.127443:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd981f04b40 x1874703885100416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857280.127453:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787857280.127460:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787857280.127466:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787857280.127469:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787857280.127472:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd97a625800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787857280.127477:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874703885100416:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787857280.129685:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1787857280.130160:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fd981f05e00 x1874703885100544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857280.130310:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885100544:0@lo:400:kworker.0 00000020:01000000:0.0:1787857280.130782:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787857280.130819:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787857280.130841:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf937 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.130854:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85400/0xf326646fe3bbf930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf937 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787857280.130922:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787857280.130924:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787857280.130925:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857280.130926:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857280.130928:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857280.130929:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857280.130931:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857280.130933:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857280.130935:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857280.130939:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787857280.130941:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787857280.130943:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787857280.130944:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857280.130945:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857280.130946:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857280.130947:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857280.130948:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857280.130949:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857280.130950:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787857280.130975:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787857280.130994:0:14995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100672:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787857280.131083:0:14995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857280.131119:0:14995:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9454853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857280.131377:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100672 00000100:00100000:2.0:1787857280.131392:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100672 00000100:00100000:2.0:1787857280.131509:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787857280.131519:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14995:x1874703885100672:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787857280.131549:0:14307:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787857280.131562:0:14307:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787857280.172920:0:14307:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787857280.172939:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787857280.173000:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787857280.173005:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787857280.173029:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.173049:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.173058:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.173098:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 16 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857280.173115:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 16 pid: 14308 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857280.173153:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885100800:0@lo:104: 00000100:00100000:1.0:1787857280.173231:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857280.173279:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cc33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857280.173505:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100800 00000100:00100000:0.0:1787857280.173512:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100800 00000100:00100000:0.0:1787857280.173571:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857280.173581:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885100800:12345-0@lo:104: 00010000:00010000:0.0:1787857280.173595:0:14298:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173655:0:14298:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857280.173712:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885100800:12345-0@lo:104: Request processed in 133us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.173718:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787857280.173743:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857280.173760:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173769:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857280.173773:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173781:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857280.173787:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857280.173793:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787857280.173828:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173835:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787857280.173857:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173864:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84e00/0xf326646fe3bbf8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8c0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.173882:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857280.173885:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857280.173886:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857280.173911:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885100928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857280.173941:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857280.174221:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885100928 00000100:00100000:0.0:1787857280.174235:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885100928 00010000:00010000:0.0:1787857280.174252:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 17 pid: 14308 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857280.174272:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857280.174277:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:3309:x1874703885100928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857280.174286:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857280.174290:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 17 pid: 14308 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174300:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 17 pid: 14308 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174316:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174323:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787857280.174335:0:14301:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001606239s 00010000:00010000:0.0:1787857280.174339:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174345:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174352:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174421:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174428:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857280.174432:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174440:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174448:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174457:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857280.174486:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:3309:x1874703885100928:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857280.174492:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857280.174543:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885100928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857280.174565:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940030e00/0xf326646fe3bbf8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf8b9 expref: 16 pid: 14308 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857280.174575:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4be940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885100800:0@lo:104: 00010000:00010000:0.0:1787857280.174588:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174597:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174612:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857280.174620:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f979c00/0xf326646fe3bbf953 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857280.188434:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14995:x1874703885100672:12345-0@lo:253:mount.lustre.0 Request processed in 56907us (57342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857280.188450:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787857280.188540:0:14995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:14995:1874703885100672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787857280.188559:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787857280.188563:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787857280.188564:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787857280.188565:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857280.188566:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857280.188567:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857280.188568:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857280.188570:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857280.188572:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857280.188573:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787857280.188587:0:14995:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787857280.196167:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857280.196528:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787857280.196789:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857280.196956:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787857280.197453:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787857280.197720:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787857280.198767:0:14995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787857280.248275:0:14995:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787857280.248284:0:14995:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787857280.248316:0:14995:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787857280.248378:0:14995:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787857280.248396:0:14995:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787857280.248424:0:14995:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787857280.716514:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787857281.607725:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787857281.607733:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96dd97000 from 7 10000000:01000000:0.0:1787857281.607739:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787857281.607788:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857281.607801:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857281.607812:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857281.607838:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885101056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857281.607928:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857281.607981:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101056 00000100:00100000:0.0:1787857281.607986:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41300 going to sleep for 11 seconds 00000100:00100000:3.0:1787857281.607988:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101056 00000100:00100000:3.0:1787857281.608044:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787857281.608054:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+15:14311:x1874703885101056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857281.608069:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857281.608083:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbf95a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857281.608107:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857281.608118:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 16 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857281.608128:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd940031000, rc 0) 00000100:00100000:3.0:1787857281.608169:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14311:x1874703885101056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857281.608200:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787857281.608254:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb583c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885101056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857281.608268:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857281.608278:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857281.608327:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885101184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787857281.608359:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857281.608382:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd975494900 going to sleep for 11 seconds 00000100:00100000:0.0:1787857281.608684:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101184 00000100:00100000:0.0:1787857281.608689:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101184 00000100:00100000:0.0:1787857281.608718:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787857281.608725:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14311:x1874703885101184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787857281.608740:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787857281.608755:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787857281.608759:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787857281.608857:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14311:x1874703885101184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857281.608871:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885101184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787857281.608875:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 10000000:01000000:3.0:1787857281.608924:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787857281.608932:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857281.608940:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857281.735968:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857282.762306:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857283.784819:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857284.808404:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787857285.449431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857285.449438:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787857285.449441:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857285.449443:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787857285.449501:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885101440:0@lo:400:kworker.0 00000100:00100000:2.0:1787857285.449589:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857285.449889:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857285.449898:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885101568:0@lo:400:kworker.0 00000100:00100000:2.0:1787857285.449931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857285.456155:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885101312:0@lo:400:kworker.0 00000100:00100000:0.0:1787857285.456230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857285.456312:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101440 00000100:00100000:0.0:1787857285.456319:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101440 00000100:00100000:0.0:1787857285.456360:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101568 00000100:00100000:0.0:1787857285.456363:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101568 00000100:00100000:0.0:1787857285.456390:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857285.456398:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885101440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857285.456578:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101312 00000100:00100000:3.0:1787857285.456583:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101312 00000100:00100000:3.0:1787857285.456613:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787857285.456620:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3310:x1874703885101312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857285.456681:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3310:x1874703885101312:12345-0@lo:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857285.456687:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787857285.456742:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857285.458330:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885101440:12345-0@lo:400:kworker.0 Request processed in 1922us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857285.458345:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787857285.458378:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857285.458391:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885101568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787857285.459647:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885101568:12345-0@lo:400:kworker.0 Request processed in 1254us (9707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857285.459658:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857285.459726:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885101312:0@lo:400:kworker.0 00010000:00080000:0.0:1787857285.459999:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e383c0 x1874703885101568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857285.460295:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885101568:0@lo:400:kworker.0 00010000:00080000:0.0:1787857285.460318:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e38780 x1874703885101440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857285.460326:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885101440:0@lo:400:kworker.0 00010000:00010000:0.0:1787857285.832181:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787857286.731910:0:15362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787857286.855832:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857287.879800:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857288.904352:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857289.933595:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857290.248586:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1787857290.568482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857290.568491:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787857290.568512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857290.568515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787857290.568582:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885101696:0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.568685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857290.568750:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787857290.568757:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885101824:0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.568785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857290.568812:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885101952:0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.568831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857290.568880:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101696 00000100:00100000:2.0:1787857290.568888:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101696 00000100:00100000:2.0:1787857290.568931:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787857290.568939:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3309:x1874703885101696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.568984:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3309:x1874703885101696:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857290.568991:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787857290.569027:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101824 00000100:00100000:2.0:1787857290.569031:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101824 00000100:00100000:2.0:1787857290.569052:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885101952 00000100:00100000:2.0:1787857290.569054:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885101952 00000100:00100000:2.0:1787857290.569077:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857290.569083:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885101824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.569110:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885101824:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857290.569115:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857290.569124:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787857290.569135:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857290.569162:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885101952:12345-0@lo:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857290.569167:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787857290.570002:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e3a1c0 x1874703885101824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857290.570020:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885101824:0@lo:400:kworker.0 00000100:00100000:3.0:1787857290.570033:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885101696:0@lo:400:kworker.0 00000100:00080000:3.0:1787857290.570073:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787857290.570094:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e39e00 x1874703885101952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857290.570105:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885101952:0@lo:400:kworker.0 00010000:00010000:1.0:1787857290.952718:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857291.976118:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857292.429946:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787857277/real 1787857277] req@ffff9fd843e3b840 x1874703885097856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857292 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857292.429978:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fd843e3b840 x1874703885097856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857292 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857292.429989:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787857277/real 1787857277] req@ffff9fd843e38000 x1874703885097984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857292 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857292.430000:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fd843e38000 x1874703885097984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787857292 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787857292.430021:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd960295000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857292.430048:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787857292.430054:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885097856:0@lo:8:kworker.0 00000100:00080000:1.0:1787857292.430061:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857292.430068:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787857292.430071:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885097984:0@lo:8:kworker.0 00000100:00080000:3.0:1787857292.430216:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787857292.430222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787857292.430225:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd960295000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787857292.430230:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:3.0:1787857292.430236:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787857292.430242:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fd960295000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857292.430262:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f05a40 x1874703885102208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787857292.430275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787857292.430278:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787857292.430280:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787857292.430283:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:3.0:1787857292.430286:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787857292.430289:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96db87000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857292.430299:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f06580 x1874703885102336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857292.430352:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857292.430364:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885102080:0@lo:400:kworker.0 00000100:00100000:3.0:1787857292.430443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857292.430499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885102464:0@lo:400:kworker.0 00000100:00100000:3.0:1787857292.430530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857292.430550:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857292.430555:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885102592:0@lo:400:kworker.0 00000100:00100000:3.0:1787857292.430578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857292.430605:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102080 00000100:00100000:3.0:1787857292.430612:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102080 00000100:00100000:3.0:1787857292.430651:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787857292.430682:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3311:x1874703885102080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857292.430727:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3311:x1874703885102080:12345-0@lo:400:kworker.0 Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857292.430734:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787857292.430775:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885102080:0@lo:400:kworker.0 00000100:00100000:1.0:1787857292.431001:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885102208:0@lo:8:kworker.0 00000100:00100000:1.0:1787857292.431043:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857292.431068:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885102336:0@lo:8:kworker.0 00000100:00100000:1.0:1787857292.431099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857292.431265:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102464 00000100:00100000:2.0:1787857292.431270:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102464 00000100:00100000:2.0:1787857292.431312:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102592 00000100:00100000:2.0:1787857292.431315:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102592 00000100:00100000:2.0:1787857292.431345:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787857292.431353:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885102464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857292.431402:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885102464:12345-0@lo:400:kworker.0 Request processed in 50us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857292.431409:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787857292.431425:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857292.431441:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885102592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857292.431473:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885102592:12345-0@lo:400:kworker.0 Request processed in 43us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857292.431480:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787857292.431513:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102208 00000100:00100000:2.0:1787857292.431516:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102208 00000100:00100000:2.0:1787857292.431534:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102336 00000100:00100000:2.0:1787857292.431538:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102336 00000100:00100000:2.0:1787857292.431548:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857292.431552:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874703885102208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787857292.431576:0:14996:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1787857292.431605:0:14996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbf968 00002000:00100000:2.0:1787857292.431628:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fd94e0c4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787857292.431632:0:14996:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787857292.431635:0:14996:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1787857292.432786:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd981f070c0 x1874703885102592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857292.432802:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885102592:0@lo:400:kworker.0 00010000:00080000:0.0:1787857292.432814:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd981f07480 x1874703885102464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787857292.432824:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885102464:0@lo:400:kworker.0 00000100:00080000:0.0:1787857292.432848:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1787857292.436273:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787857292.436313:0:14996:0:(import.c:65:import_set_state_nolock()) ffff9fd94e0c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857292.438336:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874703885102208:12345-0@lo:8:kworker.0 Request processed in 6772us (7283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857292.438350:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857292.438384:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857292.438390:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874703885102336:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787857292.438409:0:14996:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787857292.438460:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874703885102336:12345-0@lo:8:kworker.0 Request processed in 69us (7360us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787857292.438467:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787857292.449526:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd981f05a40 x1874703885102208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857292.449546:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787857292.449558:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787857292.449569:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787857292.449575:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787857292.449578:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd960295000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787857292.449612:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787857292.449620:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885102208:0@lo:8:kworker.0 00000004:00080000:3.0:1787857292.449797:0:14337:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787857292.449823:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14337:1874703885102848:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787857292.449912:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857292.449946:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddce900 going to sleep for 11 seconds 00000100:00100000:3.0:1787857292.449984:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885102720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857292.450018:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857292.450080:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102720 00000100:00100000:3.0:1787857292.450088:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102720 00000100:00100000:3.0:1787857292.450170:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787857292.450182:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885102720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787857292.450219:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787857292.450274:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885102720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857292.450283:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787857292.450328:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd981f06d00 x1874703885102720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857292.450348:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885102720:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1787857292.450545:0:14336:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1787857292.450575:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857292.450581:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787857292.450586:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885102336:0@lo:8:kworker.0 00000100:00100000:2.0:1787857292.451775:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102848 00000100:00100000:2.0:1787857292.451786:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102848 00000100:00100000:2.0:1787857292.451898:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787857292.451908:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14337:x1874703885102848:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787857292.453721:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787857292.455183:0:14336:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446783521162ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787857292.463078:0:14997:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787857292.463089:0:14997:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787857292.463094:0:14997:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787857292.479348:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.479364:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479444:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.479449:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.479462:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479481:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479493:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479500:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479521:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.479535:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.479542:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479551:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.479556:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479565:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479586:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479607:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf96f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.479651:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.479654:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.479656:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787857292.485419:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.485444:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485461:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.485466:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.485472:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485485:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485494:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485500:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485523:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.485535:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.485547:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485554:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.485558:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485566:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485582:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485589:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf976 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.485608:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.485610:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.485612:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787857292.486522:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.486532:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.486543:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.486547:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.486551:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.486574:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.486583:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.486590:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488357:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.488380:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.488388:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488401:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.488405:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488416:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488447:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488457:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf97d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.488489:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.488491:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.488493:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787857292.489705:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.489714:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.489729:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.489734:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.489740:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.489754:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.489763:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.489770:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.489790:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857292.490335:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857292.490344:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.490353:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857292.490358:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.490367:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.490387:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.490394:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e7bb21a/0xf326646fe3bbf984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.490416:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857292.490418:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857292.490419:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787857292.492526:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.492538:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.492566:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.492571:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.492579:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.492593:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.492603:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.492612:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.492632:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.492647:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.492652:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.493071:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.493076:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.493086:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.493261:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.493446:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf98b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.493469:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.493472:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.493474:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787857292.495535:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.495549:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.495565:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.495570:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.495577:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.495591:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.495601:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.495608:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.495636:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857292.495740:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857292.495748:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.495758:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857292.495763:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.495784:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.495802:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.495810:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab451234/0xf326646fe3bbf992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.495830:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857292.495832:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857292.495835:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857292.500416:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.500442:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.500462:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.500467:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.500474:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.500493:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.500505:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.500513:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.500545:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.500833:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.500841:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.500921:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.500927:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.500947:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.501089:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.501098:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a87e2b4/0xf326646fe3bbf999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.501131:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.501134:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.501136:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857292.502129:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.502139:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502152:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.502156:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.502162:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502173:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502183:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502190:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502211:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857292.502629:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.502636:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502645:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.502653:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.502682:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502693:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502701:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502709:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.502723:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787857292.503141:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.503148:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.503157:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.503159:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.503164:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.503173:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.503181:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.503195:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.503203:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787857292.504700:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787857292.504712:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504723:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.504741:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504750:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504770:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504778:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045b82618/0xf326646fe3bbf9a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504800:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857292.504805:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504824:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.504828:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504835:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504851:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504859:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039712318/0xf326646fe3bbf9a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504879:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.504883:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504889:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.504892:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504899:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504908:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504915:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ff0fc5/0xf326646fe3bbf9ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.504927:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.504929:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.504930:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857292.505142:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857292.505544:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787857292.506792:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.506803:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507095:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.507102:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.507110:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507174:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507185:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507193:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507247:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857292.507864:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.507870:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507890:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.507893:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.507898:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507907:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507915:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.507939:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509556:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857292.509572:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509584:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.509598:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509610:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509631:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509638:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926cf945/0xf326646fe3bbf9b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509672:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.509677:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509685:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.509687:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509695:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509705:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.509714:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.509723:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.509726:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.513507:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857292.513524:0:14997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c718e8d6/0xf326646fe3bbf9bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.513572:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857292.517733:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.517747:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.517765:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.517769:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.517776:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.517802:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.517823:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.517831:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.525477:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857292.530058:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857292.530075:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.530094:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:3.0:1787857292.530098:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857292.530105:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.530121:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.530132:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.530155:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530418:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857292.530439:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530448:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940031600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.530453:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530463:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530481:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530488:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007251c8ce/0xf326646fe3bbf9c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530510:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.530513:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530518:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.530521:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530541:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530550:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.530579:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.530581:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.530583:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.531151:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857292.531160:0:14997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba69835/0xf326646fe3bbf9ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857292.531883:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.531892:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.531902:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.531907:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.531913:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.531925:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.531934:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.531941:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.531981:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787857292.532356:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.532362:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532371:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.532374:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.532378:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532388:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532395:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532403:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532410:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787857292.532845:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.532852:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532860:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.532870:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.532874:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532884:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532892:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532899:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.532907:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787857292.533303:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.533308:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533316:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.533318:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.533322:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533331:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533338:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533351:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533358:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787857292.533814:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787857292.533821:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533830:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1787857292.533833:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857292.533837:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533846:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533853:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533861:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.533869:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787857292.534502:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787857292.534511:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534520:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.534524:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534534:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534551:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534558:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbf9d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534578:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787857292.534587:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534594:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.534596:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534603:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534613:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534620:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036a3e5c5/0xf326646fe3bbf9d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534632:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787857292.534635:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534641:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.534643:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534650:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534683:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534690:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b037a7d5/0xf326646fe3bbf9df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534703:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857292.534706:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534712:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.534715:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534722:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534731:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534737:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7f81b25/0xf326646fe3bbf9e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534749:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.534752:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534764:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.534768:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534775:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534785:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534792:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd038aba/0xf326646fe3bbf9ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.534805:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.534819:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.534821:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.534943:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.538738:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.538753:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.538771:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.538776:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.538783:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.538800:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.538811:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.538831:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.538856:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857292.538891:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.538901:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.538911:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.538916:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.538925:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.538961:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.538969:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29f2d4d/0xf326646fe3bbf9f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.538993:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.538995:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.538998:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.539396:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.539402:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539410:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.539413:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.539416:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539439:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539447:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539454:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539474:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857292.539719:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857292.539735:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.539745:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857292.539749:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.539759:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.539775:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.539782:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0228b1c/0xf326646fe3bbf9fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.539805:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.539818:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.539820:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.539882:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.539888:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539902:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.539905:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.539910:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539920:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539928:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539937:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.539956:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857292.540026:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.540032:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540040:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.540044:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540053:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540065:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540072:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbd56fbf/0xf326646fe3bbfa02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540101:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.540104:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.540107:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.540321:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.540326:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540334:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.540337:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.540342:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540351:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540369:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540376:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540394:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857292.540460:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857292.540467:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.540474:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857292.540478:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.540498:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.540511:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.540518:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e9221f5/0xf326646fe3bbfa09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.540540:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.540543:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.540546:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.540780:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.540786:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540795:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.540798:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.540802:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540812:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540820:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540827:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.540856:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857292.540892:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.540899:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540907:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.540911:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540919:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540932:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540940:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6377a7/0xf326646fe3bbfa10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.540967:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.540970:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.540972:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.541195:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.542082:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.542098:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.542101:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.542108:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.542121:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.542131:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.542138:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.542169:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857292.542486:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857292.542493:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.542502:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857292.542506:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.542516:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.542530:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.542550:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d20875b/0xf326646fe3bbfa17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857292.542569:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.542570:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857292.542572:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.543204:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.543215:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543226:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.543237:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.543243:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543254:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543262:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543268:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543290:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857292.543351:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.543360:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.543380:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975560200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.543384:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.543392:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.543404:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.543411:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f26e409/0xf326646fe3bbfa1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.543442:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.543444:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.543447:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.543760:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.543766:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543775:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.543778:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.543781:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543790:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543799:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543811:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.543834:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787857292.543888:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857292.543896:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.543912:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857292.543916:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.543924:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.543937:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.543945:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000181c6e18/0xf326646fe3bbfa25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857292.543974:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.543975:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857292.543978:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787857292.544239:0:14997:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787857292.544245:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.544254:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:0.0:1787857292.544257:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857292.544261:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.544269:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.544276:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.544282:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857292.544301:0:14997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857292.544407:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857292.544414:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.544423:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c2200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857292.544438:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.544448:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.544471:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857292.544478:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b70dd94a/0xf326646fe3bbfa2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787857292.544487:0:14997:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1787857292.544495:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.544497:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857292.544500:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857292.544607:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14337:x1874703885102848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 92696us (94693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857292.544627:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787857292.544631:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14337:1874703885102848:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787857292.544650:0:14337:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787857292.546557:0:14337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14337:1874703885102976:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787857292.546633:0:14337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857292.546717:0:14337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857292.547763:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885102976 00000100:00100000:2.0:1787857292.547776:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885102976 00000100:00100000:2.0:1787857292.547881:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857292.547892:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14337:x1874703885102976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787857292.547944:0:14996:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787857292.562578:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14337:x1874703885102976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14679us (15935us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787857292.562591:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787857292.564642:0:14337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14337:1874703885102976:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787857292.564683:0:14337:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787857292.999795:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787857293.916216:0:15713:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787857293.916220:0:15713:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787857293.916472:0:15713:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fd97535c000 00000020:01000004:1.0:1787857293.916488:0:15713:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787857293.916501:0:15713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787857293.916516:0:15713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fd841234d70) 00000020:00000080:1.0:1787857293.916532:0:15713:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787857293.948207:0:15713:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787857293.948509:0:15713:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787857293.949346:0:15713:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787857293.949610:0:15713:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787857293.949844:0:15713:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787857293.950222:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 425: rc = 0 00100000:10000000:3.0:1787857293.950327:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:3.0:1787857293.951102:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 425: rc = 0 00100000:10000000:3.0:1787857293.951630:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1787857293.952291:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1787857293.952576:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:3.0:1787857293.953269:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1787857293.953559:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:3.0:1787857293.954185:0:15713:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00000020:00000080:3.0:1787857293.957530:0:15713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787857293.957549:0:15713:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787857293.957562:0:15713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf326646fe3bbfa3a 00000020:01000004:3.0:1787857293.957571:0:15713:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787857293.957592:0:15713:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787857293.957595:0:15713:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787857293.957602:0:15713:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787857293.957625:0:15713:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787857293.957629:0:15713:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787857293.986737:0:15713:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787857293.986777:0:15713:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.129@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787857293.986782:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787857293.986783:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787857293.986785:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857293.986786:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857293.986787:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857293.986789:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857293.986791:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857293.986792:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857293.986794:0:15713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787857293.986797:0:15713:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787857293.986800:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787857293.986802:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787857293.986803:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857293.986804:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857293.986805:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857293.986806:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857293.986807:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857293.986808:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857293.986809:0:15713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787857293.986836:0:15713:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787857293.986858:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787857293.986934:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857293.986997:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945f0b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857293.987379:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103104 00000100:00100000:3.0:1787857293.987386:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103104 00000100:00100000:3.0:1787857293.987450:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787857293.987460:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:15713:x1874703885103104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787857293.987491:0:14309:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787857293.987495:0:14309:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787857293.987499:0:14309:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787857294.007371:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:15713:x1874703885103104:12345-0@lo:253:mount.lustre.0 Request processed in 19902us (20427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.007387:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787857294.007562:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787857294.007581:0:15713:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787857294.007585:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787857294.007600:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787857294.007602:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787857294.007603:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787857294.007604:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787857294.007606:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787857294.007608:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787857294.007610:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787857294.007611:0:15713:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787857294.007630:0:15713:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fd97535c000 from lustre-OST0001 10000000:01000000:0.0:1787857294.007703:0:15713:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787857294.007715:0:15713:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787857294.007723:0:15713:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fd8412333a0 local copy 00010000:00010000:0.0:1787857294.007734:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857294.008094:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857294.008134:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.008529:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787857294.015105:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103232 00000100:00100000:2.0:1787857294.015136:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103232 00000100:00100000:2.0:1787857294.015191:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787857294.015201:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:15713:x1874703885103232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857294.015718:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:15713:x1874703885103232:12345-0@lo:501:mount.lustre.0 Request processed in 516us (7581us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787857294.015726:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787857294.018061:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787857294.018104:0:15713:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787857294.018938:0:15713:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787857294.018950:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.018962:0:15713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85e00/0xf326646fe3bbf7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbf7e7 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857294.018997:0:15713:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fd97535c000 10000000:01000000:1.0:1787857294.019002:0:15713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787857294.019009:0:15713:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787857294.019011:0:15713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787857294.019016:0:15713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787857294.019019:0:15713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787857294.019054:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.019063:0:15713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.019075:0:15713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857294.019110:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787857294.019177:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857294.019235:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94357d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.019931:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103360 00000100:00100000:3.0:1787857294.019939:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103360 00000100:00100000:3.0:1787857294.019998:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787857294.020009:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+16:15713:x1874703885103360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857294.020022:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857294.020036:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbfa48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfa41 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.020060:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbfa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfa41 expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.020071:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045c00/0xf326646fe3bbfa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfa41 expref: 17 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.020271:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045c00, rc 0) 00000100:00100000:3.0:1787857294.020694:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103360:12345-0@lo:101:mount.lustre.0 Request processed in 654us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.020702:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787857294.020961:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787857294.020980:0:15713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa48 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.020989:0:15713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfa48 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787857294.023648:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787857294.024711:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1787857294.026126:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857294.027048:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787857294.028125:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787857294.028173:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787857294.028243:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787857294.028280:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787857294.028314:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787857294.028895:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787857294.028907:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787857294.029022:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857294.029105:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.029154:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.029343:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103488 00000100:00100000:3.0:1787857294.029351:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103488 00000100:00100000:3.0:1787857294.029414:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787857294.029424:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857294.030272:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103488:12345-0@lo:501:mount.lustre.0 Request processed in 846us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.030282:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787857294.030507:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787857294.030548:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787857294.030593:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.030626:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01180 going to sleep for 11 seconds 00000100:00100000:2.0:1787857294.032201:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103616 00000100:00100000:2.0:1787857294.032215:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103616 00000100:00100000:2.0:1787857294.032283:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787857294.032294:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857294.032753:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103616:12345-0@lo:503:mount.lustre.0 Request processed in 459us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857294.032761:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787857294.033138:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787857294.037567:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787857294.037696:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787857294.037789:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.037842:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.038481:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103744 00000100:00100000:3.0:1787857294.038489:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103744 00000100:00100000:3.0:1787857294.038548:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787857294.038557:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787857294.038880:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975518c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103744:12345-0@lo:502:mount.lustre.0 Request processed in 322us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.038888:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787857294.039286:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787857294.039573:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787857294.039626:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787857294.039718:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787857294.039782:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787857294.039818:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787857294.039847:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787857294.039893:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787857294.039925:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787857294.039965:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787857294.040001:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787857294.040057:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.040105:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.041560:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885103872 00000100:00100000:1.0:1787857294.041574:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885103872 00000100:00100000:1.0:1787857294.041737:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787857294.041787:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857294.042260:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885103872:12345-0@lo:502:mount.lustre.0 Request processed in 487us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.042268:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787857294.043465:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885103872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787857294.043615:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787857294.043632:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787857294.053055:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787857294.053067:0:15715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787857294.053074:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.053076:0:15715:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787857294.053092:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787857294.053125:0:15715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fd841c433a0) 00000020:00000080:1.0:1787857294.053149:0:15715:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787857294.053156:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787857294.053217:0:15715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd97535c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787857294.053225:0:15715:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787857294.053231:0:15715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf326646fe3bbfa56 00010000:00010000:1.0:1787857294.062758:0:15715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787857294.063500:0:15715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787857294.066885:0:15715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787857294.079837:0:15715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787857294.079850:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857294.079857:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857294.079859:0:15715:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787857294.079863:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857294.079868:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857294.079870:0:15715:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787857294.079878:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787857294.079880:0:15715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787857294.079883:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857294.079885:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857294.079887:0:15715:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787857294.079889:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787857294.079891:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857294.079893:0:15715:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787857294.079896:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787857294.079962:0:15715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787857294.079966:0:15715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787857294.079967:0:15715:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787857294.079971:0:15715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787857294.084862:0:15713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787857294.084916:0:15713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787857294.084944:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa48 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.084958:0:15713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97f978e00/0xf326646fe3bbfa41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa48 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857294.084967:0:15713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd97535c000 from 1 10000000:01000000:0.0:1787857294.084970:0:15713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787857294.085024:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.085033:0:15713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.085045:0:15713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857294.085193:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787857294.085265:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857294.085363:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea01180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.091515:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104000 00000100:00100000:1.0:1787857294.091537:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104000 00000100:00100000:0.0:1787857294.092505:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787857294.092522:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:15713:x1874703885104000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787857294.092543:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857294.092565:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfa5d expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.092596:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.092610:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857294.092620:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2c00, rc 0) 00000100:00100000:0.0:1787857294.092751:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104000:12345-0@lo:101:mount.lustre.0 Request processed in 235us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857294.092758:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787857294.093823:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787857294.093849:0:15713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857294.093860:0:15713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787857294.094458:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787857294.094960:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787857294.095225:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787857294.095271:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787857294.095329:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787857294.095336:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787857294.095417:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857294.095491:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.095536:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.096088:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104128 00000100:00100000:1.0:1787857294.096096:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104128 00000100:00100000:1.0:1787857294.096146:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787857294.096173:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857294.096422:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975519050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104128:12345-0@lo:501:mount.lustre.0 Request processed in 249us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.096431:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787857294.096737:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787857294.096851:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787857294.096896:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.096919:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.097022:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104256 00000100:00100000:3.0:1787857294.097028:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104256 00000100:00100000:3.0:1787857294.097095:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787857294.097103:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857294.097343:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975518450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104256:12345-0@lo:503:mount.lustre.0 Request processed in 240us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.097351:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787857294.097637:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787857294.098368:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787857294.098592:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857294.098652:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.098888:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.099274:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104384 00000100:00100000:3.0:1787857294.099281:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104384 00000100:00100000:3.0:1787857294.099331:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787857294.099340:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787857294.099742:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104384:12345-0@lo:502:mount.lustre.0 Request processed in 403us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.099751:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787857294.099928:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787857294.100327:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787857294.100387:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787857294.100452:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787857294.100491:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787857294.100527:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787857294.100578:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787857294.100617:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787857294.100652:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787857294.101106:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787857294.101165:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.101204:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.101344:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104512 00000100:00100000:1.0:1787857294.101350:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104512 00000100:00100000:1.0:1787857294.101410:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787857294.101420:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96d8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857294.101629:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96d8ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104512:12345-0@lo:502:mount.lustre.0 Request processed in 210us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.101637:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787857294.101905:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787857294.102013:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787857294.102037:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787857294.103427:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857294.103440:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103442:0:15719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787857294.103449:0:15719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd97535c000 00000020:00000080:1.0:1787857294.103452:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787857294.103459:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857294.103461:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103462:0:15719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787857294.103465:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857294.103467:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103468:0:15719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787857294.103471:0:15719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fd97535c000 00000020:00000080:1.0:1787857294.103472:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787857294.103539:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857294.103544:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103545:0:15719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787857294.103548:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787857294.103551:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103552:0:15719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787857294.103565:0:15719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fd97535c000 00000020:00000080:1.0:1787857294.103567:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787857294.103619:0:15719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787857294.103623:0:15719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787857294.103625:0:15719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787857294.103628:0:15719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787857294.104889:0:15713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787857294.104922:0:15713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787857294.104938:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.104950:0:15713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857294.104996:0:15713:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787857294.104999:0:15713:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fd97535c000 10000000:01000000:3.0:1787857294.105001:0:15713:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fd97535c000 10000000:01000000:3.0:1787857294.105006:0:15713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787857294.105012:0:15713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fd97535c000 from 1 10000000:01000000:3.0:1787857294.105014:0:15713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787857294.105048:0:15713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105057:0:15713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105202:0:15713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857294.105231:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787857294.105298:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.105346:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104640 00000100:00100000:3.0:1787857294.105354:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104640 00000100:00100000:3.0:1787857294.105411:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787857294.105420:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885104640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857294.105445:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857294.105457:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982044000/0xf326646fe3bbfa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfa6b expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105483:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982044000/0xf326646fe3bbfa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfa6b expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105494:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982044000/0xf326646fe3bbfa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfa6b expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105503:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982044000, rc 0) 00000100:00100000:3.0:1787857294.105535:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885104640:12345-0@lo:101:mount.lustre.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.105541:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787857294.105584:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94316d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.105604:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787857294.105624:0:15713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa72 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.105632:0:15713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfa72 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857294.112932:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787857294.114006:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787857294.116359:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787857294.116504:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787857294.116535:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787857294.116576:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787857294.116613:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787857294.116810:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787857294.116846:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787857294.116873:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787857294.116929:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787857294.116958:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787857294.116984:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787857294.117032:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787857294.117062:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787857294.117267:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787857294.117311:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787857294.117514:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787857294.117546:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787857294.117587:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787857294.117638:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787857294.122147:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787857294.122238:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787857294.122277:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787857294.122311:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787857294.122414:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787857294.122472:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787857294.122508:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787857294.122558:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787857294.122592:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787857294.122626:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787857294.122750:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787857294.125451:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787857294.125525:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787857294.125561:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787857294.125642:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787857294.125703:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787857294.125757:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787857294.125930:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787857294.126034:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787857294.126055:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787857294.126961:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857294.127033:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.127890:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104768 00000100:00100000:3.0:1787857294.127900:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104768 00000100:00100000:3.0:1787857294.128945:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787857294.128960:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885104768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787857294.129951:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885104768:12345-0@lo:501:mount.lustre.0 Request processed in 992us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.129960:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787857294.131168:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94316d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.131200:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787857294.131258:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787857294.131313:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857294.131352:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.131483:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885104896 00000100:00100000:3.0:1787857294.131489:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885104896 00000100:00100000:3.0:1787857294.131544:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787857294.131554:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885104896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787857294.135500:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885104896:12345-0@lo:503:mount.lustre.0 Request processed in 3939us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.135516:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787857294.135593:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bcf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885104896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787857294.136263:0:15713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787857294.136339:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787857294.136386:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.136445:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105024 00000100:00100000:3.0:1787857294.136451:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105024 00000100:00100000:3.0:1787857294.136497:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787857294.136507:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885105024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787857294.136800:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885105024:12345-0@lo:502:mount.lustre.0 Request processed in 293us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.136813:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787857294.136864:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94316d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787857294.136886:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787857294.137122:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787857294.137171:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787857294.137207:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787857294.137256:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787857294.137292:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787857294.137341:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787857294.137377:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787857294.137428:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787857294.137490:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787857294.137549:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787857294.137592:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787857294.137686:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787857294.146657:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787857294.146751:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787857294.146829:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787857294.146891:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787857294.146926:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787857294.146977:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787857294.147014:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787857294.147046:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787857294.147093:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787857294.147128:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787857294.147162:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787857294.147209:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787857294.147243:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787857294.147275:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787857294.147323:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787857294.147616:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787857294.147652:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787857294.147796:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787857294.147834:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787857294.147886:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787857294.147921:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787857294.147967:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787857294.148005:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787857294.148052:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787857294.148087:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787857294.148119:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787857294.148176:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787857294.148213:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787857294.148264:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787857294.150029:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.150240:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9604129c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.152450:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105152 00000100:00100000:1.0:1787857294.152465:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105152 00000100:00100000:1.0:1787857294.152534:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787857294.152543:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885105152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787857294.152872:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885105152:12345-0@lo:502:mount.lustre.0 Request processed in 329us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.152880:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787857294.153036:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787857294.153152:0:15713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787857294.153168:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787857294.159814:0:15724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787857294.159832:0:15724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fd96db88000) 00000020:00000080:2.0:1787857294.159855:0:15724:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787857294.159952:0:15724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fd97535c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787857294.159956:0:15724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fd97535c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787857294.159959:0:15724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fd97535c000 3 00010000:00080000:2.0:1787857294.159990:0:15724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fd96039d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.129@tcp at head 00010000:00010000:2.0:1787857294.163089:0:15724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787857294.163299:0:15724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787857294.166145:0:15724:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787857294.166163:0:15724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf326646fe3bbfa80 00000100:00080000:2.0:1787857294.166174:0:15724:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787857294.166181:0:15724:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fd96039d800 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857294.166219:0:15724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd843e39680 x1874703885105280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787857294.166278:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885105280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787857294.166366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787857294.167430:0:15724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787857294.167486:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787857294.167491:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787857294.167494:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787857294.167499:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:2.0:1787857294.167505:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787857294.167511:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96db87000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:2.0:1787857294.167530:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd843e392c0 x1874703885105536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857294.167615:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105280 00000100:00100000:3.0:1787857294.167623:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105280 00000100:00100000:3.0:1787857294.167676:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857294.167685:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874703885105280:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787857294.167710:0:14316:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1787857294.167743:0:14316:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf326646fe3bbfa87 00000004:00100000:3.0:1787857294.167760:0:14316:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787857294.167794:0:14316:0:(import.c:65:import_set_state_nolock()) ffff9fd97fbfe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857294.170787:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885105536:0@lo:8:kworker.0 00000100:00100000:1.0:1787857294.170867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.170967:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874703885105280:12345-0@lo:38:llog_process_th.0 Request processed in 3278us (4598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.170996:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787857294.171448:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105536 00000100:00100000:0.0:1787857294.171464:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105536 00000100:00100000:0.0:1787857294.171499:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857294.171506:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1874703885105536:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787857294.171570:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1874703885105536:12345-0@lo:8:kworker.0 Request processed in 63us (703us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787857294.171581:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857294.171933:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787857294.171948:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885105408:0@lo:400:kworker.0 00000100:00100000:0.0:1787857294.171985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.175060:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105408 00000100:00100000:2.0:1787857294.175070:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105408 00000100:00100000:2.0:1787857294.175141:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857294.175151:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885105408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857294.175248:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885105408:12345-0@lo:400:kworker.0 Request processed in 99us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857294.175269:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787857294.175298:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885105792:0@lo:400:kworker.0 00000100:00100000:0.0:1787857294.175430:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885105664:0@lo:400:kworker.0 00010000:00080000:1.0:1787857294.175715:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e39680 x1874703885105280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787857304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857294.175727:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787857294.175737:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787857294.175776:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787857294.175782:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787857294.175786:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96039d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787857294.175794:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874703885105280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787857294.175826:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787857294.175830:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787857294.175834:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787857294.175837:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885105536:0@lo:8:kworker.0 00000100:00100000:0.0:1787857294.176724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.176834:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105664 00000100:00100000:3.0:1787857294.176842:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105664 00000100:00100000:3.0:1787857294.176893:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787857294.176902:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885105664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857294.176959:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885105664:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.176967:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787857294.176998:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e3bc00 x1874703885105664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857294.177009:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885105664:0@lo:400:kworker.0 00000100:00100000:2.0:1787857294.177115:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787857294.177158:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857294.177182:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885105408:0@lo:400:kworker.0 00000040:00080000:0.0:1787857294.177423:0:15724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787857294.177634:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105792 00000100:00100000:3.0:1787857294.177639:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105792 00000100:00100000:3.0:1787857294.177706:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787857294.177714:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885105792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857294.177759:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885105792:12345-0@lo:400:kworker.0 Request processed in 46us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.177765:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787857294.177792:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fd843e3b0c0 x1874703885105792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857294.177803:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885105792:0@lo:400:kworker.0 00000020:01000000:3.0:1787857294.177837:0:15713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787857294.177865:0:15713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787857294.177881:0:15713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa72 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857294.177904:0:15713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd982045400/0xf326646fe3bbfa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa72 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787857294.177949:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787857294.177950:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787857294.177952:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857294.177954:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857294.177955:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857294.177956:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857294.177957:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857294.177959:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857294.177961:0:15713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787857294.177964:0:15713:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787857294.177967:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787857294.177968:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787857294.177969:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787857294.177971:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787857294.177972:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787857294.177973:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787857294.177974:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787857294.177975:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787857294.177976:0:15713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787857294.177994:0:15713:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787857294.178008:0:15713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787857294.178047:0:15713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857294.178073:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885105920 00000100:00100000:3.0:1787857294.178077:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885105920 00000100:00100000:3.0:1787857294.178103:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787857294.178110:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:15713:x1874703885105920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787857294.178132:0:14307:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787857294.178146:0:14307:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787857294.178430:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857294.178469:0:15713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd94316d6c0 going to sleep for 11 seconds 20000000:01000000:3.0:1787857294.212890:0:14307:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787857294.212915:0:14307:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787857294.214068:0:14330:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787857294.214076:0:14330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787857294.214112:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214132:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214141:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214186:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214201:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 19 pid: 14309 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857294.214216:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885106048:0@lo:104: 00000100:00100000:1.0:1787857294.214287:0:14330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857294.214507:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106048 00000100:00100000:2.0:1787857294.214514:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106048 00000100:00100000:2.0:1787857294.214566:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857294.214576:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885106048:12345-0@lo:104: 00010000:00010000:2.0:1787857294.214589:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857294.214638:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787857294.214644:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:14330:x1874703885106048:12345-0@lo:104: Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857294.214650:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787857294.214801:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857294.214825:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14330:1874703885106048:0@lo:104: 00010000:00010000:1.0:1787857294.214856:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214874:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857294.214880:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214887:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd975561e00 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857294.214891:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214899:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857294.214905:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857294.214911:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787857294.214947:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214954:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857294.214974:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214981:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd975561e00/0xf326646fe3bbf95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf961 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.214997:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857294.214999:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857294.215001:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857294.215020:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885106176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857294.215050:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857294.215150:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106176 00000100:00100000:1.0:1787857294.215155:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106176 00010000:00010000:1.0:1787857294.215174:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 20 pid: 14309 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857294.215198:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787857294.215204:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64833f6a-f420-4926-9238-fdfd3153a5b1+20:3311:x1874703885106176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857294.215216:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857294.215221:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 20 pid: 14309 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215232:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 20 pid: 14309 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215245:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031000/0xf326646fe3bbf961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf95a expref: 20 pid: 14309 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215258:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215266:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787857294.215278:0:14301:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001606239s 00010000:00010000:1.0:1787857294.215282:0:14301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215289:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215303:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215309:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215314:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857294.215318:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215324:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215441:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215450:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857294.215481:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3311:x1874703885106176:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857294.215488:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787857294.215520:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885106176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857294.215535:0:14330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215542:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857294.215549:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f979800/0xf326646fe3bbfa8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857294.226380:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+18:15713:x1874703885105920:12345-0@lo:253:mount.lustre.0 Request processed in 48259us (48321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857294.226405:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787857294.226528:0:15713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64833f6a-f420-4926-9238-fdfd3153a5b1:15713:1874703885105920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787857294.226545:0:15713:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787857294.226549:0:15713:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787857294.226550:0:15713:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787857294.226552:0:15713:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787857294.226553:0:15713:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787857294.226554:0:15713:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787857294.226555:0:15713:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787857294.226557:0:15713:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787857294.226559:0:15713:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787857294.226560:0:15713:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787857294.226592:0:15713:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787857294.234009:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857294.234196:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857294.234360:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857294.234520:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787857294.236966:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787857294.237380:0:15713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787857294.239390:0:15713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787857294.320692:0:15713:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787857294.320714:0:15713:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787857294.320750:0:15713:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787857294.320811:0:15713:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787857294.320824:0:15713:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787857294.320852:0:15713:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787857295.049037:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857295.778648:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787857295.778713:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787857296.077555:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787857296.206830:0:14311:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787857296.206838:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fd96dd97000 from 8 10000000:01000000:0.0:1787857296.206844:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787857296.206889:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857296.207133:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857296.207150:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857296.207178:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885106304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857296.207253:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857296.207306:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd942e71540 going to sleep for 11 seconds 00000100:00100000:3.0:1787857296.207639:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106304 00000100:00100000:3.0:1787857296.207647:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106304 00000100:00100000:3.0:1787857296.210247:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787857296.210268:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885106304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857296.210287:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857296.210307:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd982045600/0xf326646fe3bbfa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfa95 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857296.210335:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd982045600/0xf326646fe3bbfa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfa95 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857296.210345:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd982045600/0xf326646fe3bbfa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfa95 expref: 19 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857296.210365:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd982045600, rc 0) 00000100:00100000:3.0:1787857296.210447:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e968850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885106304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857296.210454:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787857296.213651:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885106304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857296.213697:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa9c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857296.213710:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfa9c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857296.214114:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e3b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885106432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787857296.214187:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857296.214913:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96b8d10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787857296.218474:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106432 00000100:00100000:1.0:1787857296.218490:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106432 00000100:00100000:1.0:1787857296.218549:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787857296.218559:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd96e96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885106432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787857296.218585:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787857296.218603:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787857296.218607:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787857296.218956:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd96e96ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885106432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 398us (4769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857296.218965:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787857296.219029:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e3b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885106432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787857296.219093:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787857296.219105:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa9c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857296.219116:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c2600/0xf326646fe3bbfa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfa9c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857297.097006:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857297.736354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857297.736382:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885106560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857297.736481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857297.736699:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106560 00000100:00100000:2.0:1787857297.736709:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106560 00000100:00080000:1.0:1787857297.736846:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857297.737170:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857297.737183:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885106560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857297.737224:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857297.737301:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885106560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857297.737308:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857297.737346:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787857297.737373:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885106560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787857298.120555:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.143958:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787857299.275279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787857299.275286:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787857299.275291:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787857299.275320:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fd96db87000 using connection 192.168.204.129@tcp/0@lo 00000100:00100000:3.0:1787857299.275349:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fd981f06d00 x1874703885106944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787857299.275461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885106688:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.275545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275597:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885107328:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.275630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275656:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857299.275692:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885106816:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.275719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275748:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885107072:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.275773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275792:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857299.275797:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885107200:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.275818:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275845:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106688 00000100:00100000:3.0:1787857299.275867:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106688 00000100:00100000:1.0:1787857299.275909:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885106944:0@lo:8:kworker.0 00000100:00100000:3.0:1787857299.275916:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787857299.275924:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3309:x1874703885106688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857299.275938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.275972:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3309:x1874703885106688:12345-0@lo:400:kworker.0 Request processed in 49us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857299.275979:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106816 00000100:00100000:3.0:1787857299.275980:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787857299.275982:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106816 00000100:00100000:3.0:1787857299.276010:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107328 00000100:00100000:1.0:1787857299.276014:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885106944 00000100:00100000:1.0:1787857299.276017:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885106944 00000100:00100000:1.0:1787857299.276028:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857299.276029:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107328 00000100:00100000:1.0:1787857299.276034:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885106816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.276048:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107072 00000100:00100000:3.0:1787857299.276050:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107072 00000100:00100000:3.0:1787857299.276060:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107200 00000100:00100000:3.0:1787857299.276063:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107200 00000100:00100000:1.0:1787857299.276066:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885106816:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857299.276072:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857299.276075:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787857299.276081:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885107328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857299.276083:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857299.276086:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874703885106944:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787857299.276108:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874703885107328:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00010000:00080000:1.0:1787857299.276110:0:14996:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000100:00100000:3.0:1787857299.276114:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787857299.276125:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787857299.276130:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885107072:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1787857299.276150:0:14996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf326646fe3bbfaa3 00000100:00100000:3.0:1787857299.276155:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874703885107072:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857299.276160:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00100000:1.0:1787857299.276163:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fd96d9a5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113951 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787857299.276167:0:14996:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1787857299.276169:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00002000:00100000:1.0:1787857299.276170:0:14996:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787857299.276174:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885107200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.276197:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885107200:12345-0@lo:400:kworker.0 Request processed in 23us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857299.276202:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787857299.276243:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd981f04000 x1874703885107200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857299.276257:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885107200:0@lo:400:kworker.0 00010000:00080000:3.0:1787857299.276266:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd981f070c0 x1874703885107072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857299.276273:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874703885107072:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.276309:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885106816:0@lo:400:kworker.0 00000100:00100000:3.0:1787857299.276319:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885106688:0@lo:400:kworker.0 00010000:00080000:3.0:1787857299.276327:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd981f06580 x1874703885107328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787857315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787857299.276335:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874703885107328:0@lo:400:kworker.0 00002000:00080000:1.0:1787857299.278125:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787857299.278164:0:14996:0:(import.c:65:import_set_state_nolock()) ffff9fd96d9a6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787857299.278266:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874703885106944:12345-0@lo:8:kworker.0 Request processed in 2176us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857299.278279:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787857299.278322:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787857299.278326:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787857299.278357:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd981f06d00 x1874703885106944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787857324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787857299.278387:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787857299.280403:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787857299.280410:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787857299.280415:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fd96db87000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787857299.280438:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787857299.280446:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd981f06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874703885106944:0@lo:8:kworker.0 00000004:00080000:1.0:1787857299.280490:0:14338:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787857299.281121:0:14338:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 453609459349ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787857299.281719:0:14339:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787857299.281747:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14339:1874703885107584:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787857299.281767:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885107456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857299.285791:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.286572:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.286658:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107584 00000100:00100000:3.0:1787857299.286680:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107584 00000100:00100000:3.0:1787857299.286745:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787857299.286760:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14339:x1874703885107584:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787857299.293289:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107456 00000100:00100000:2.0:1787857299.293311:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107456 00000100:00100000:2.0:1787857299.294513:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787857299.294541:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885107456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857299.294595:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857299.295321:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885107456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 791us (9538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857299.295331:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787857299.295703:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946148f00 going to sleep for 11 seconds 00000100:00080000:2.0:1787857299.296085:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787857299.297849:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fd97ba3f840 x1874703885107456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787857315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787857299.297886:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885107456:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787857299.306844:0:14998:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787857299.306858:0:14998:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787857299.306864:0:14998:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1787857299.330655:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.330701:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.330728:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.330733:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.330739:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.330913:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.330926:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.330933:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.330955:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857299.330975:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857299.330983:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.330991:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982044600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857299.330995:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.331005:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.331025:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.331038:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2ec5259/0xf326646fe3bbfaaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.331059:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857299.331061:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857299.331062:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.331585:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.331593:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.331702:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.331706:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.331711:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.331722:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.331742:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.331832:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.331849:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.332333:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.332341:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332350:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.332353:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.332358:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332368:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332375:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332478:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332509:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787857299.332523:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857299.332528:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332536:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.332540:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332549:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332562:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332570:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000965ea854/0xf326646fe3bbfab1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332585:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.332588:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332594:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd982045e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.332597:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332629:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332638:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332645:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076230d98/0xf326646fe3bbfab8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.332679:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.332681:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.332683:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857299.333416:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.333932:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.333942:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.333956:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.333960:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.333965:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.333977:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.333988:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334003:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334150:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857299.334160:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.334165:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334172:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.334176:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334184:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334197:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334204:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d01ce289/0xf326646fe3bbfabf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334219:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.334220:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.334222:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.334924:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.334939:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334949:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.334953:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.334959:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334969:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334977:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.334984:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.335007:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787857299.335926:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857299.335936:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.335947:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857299.335951:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.335961:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.335981:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.335989:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5e5e94/0xf326646fe3bbfac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857299.336012:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857299.336014:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857299.336024:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.338206:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.338218:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.338234:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.338239:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.338246:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.338258:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.338277:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.338284:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.338320:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857299.338885:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.338894:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.338903:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216de00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.338907:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.338917:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.338939:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.338946:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfacd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.338967:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.338968:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.338970:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.339603:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.339610:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.339622:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.339626:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.339631:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.339641:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.339650:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.339656:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.339716:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857299.340208:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.340215:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340224:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216cc00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.340228:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340250:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340265:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340272:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd2a280f/0xf326646fe3bbfad4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340292:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.340306:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.340308:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.340506:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.340512:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.340522:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.340527:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.340532:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.340542:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.340550:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.340557:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.340580:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857299.340914:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.340920:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340929:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.340933:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340940:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340953:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340972:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043ff0a2d/0xf326646fe3bbfadb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.340990:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.340991:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.340993:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.341564:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.341571:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.341581:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.341591:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.341597:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.341607:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.341616:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.341623:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.341727:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.342248:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.342256:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.342267:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.342270:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.342275:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.342284:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.342304:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.342318:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343838:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857299.343850:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343863:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216d600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.343867:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343878:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343903:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343910:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043cd54d5/0xf326646fe3bbfae2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343933:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.343937:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343956:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216dc00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.343958:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343965:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343975:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.343983:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.343985:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.343986:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.345475:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.345490:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a60f7386/0xf326646fe3bbfae9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857299.346538:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.346549:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.346565:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.346570:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.346577:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.346591:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.346600:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.346608:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.349141:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.349160:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.349175:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216ca00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.349181:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.349193:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.349218:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.349239:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.349241:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.349243:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.349494:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.349502:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945216c8/0xf326646fe3bbfaf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.350125:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.352276:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.352292:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.352319:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.352323:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.352330:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.352347:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.352358:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.352365:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.352491:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.353609:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.353620:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.353640:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.353644:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.353650:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.353958:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.353966:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.353976:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd98216de00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.353982:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.353994:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.354149:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.354159:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c5b9bde/0xf326646fe3bbfaf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.354192:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.354194:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.354196:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.354258:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.354269:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.354278:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.354311:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.355003:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.355084:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355097:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.355102:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.355108:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355118:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355140:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355148:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355165:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787857299.355177:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787857299.355182:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355190:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.355193:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355202:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355214:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355223:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfafe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355236:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.355245:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355252:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.355255:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355263:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355273:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355281:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.355302:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.355304:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.355306:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.355861:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.356003:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.356080:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356092:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.356095:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.356101:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356122:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356132:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356140:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356153:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857299.356161:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.356165:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356172:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.356175:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356183:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356194:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356202:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383a175d/0xf326646fe3bbfb0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356221:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.356223:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.356225:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.356733:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.356738:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356819:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.356823:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.356827:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356837:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356845:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356851:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356865:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857299.356872:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.356875:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356892:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.356895:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356903:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356914:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356921:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032511e9b/0xf326646fe3bbfb13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.356934:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.356936:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.356938:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.360207:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.360224:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.360245:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.360249:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.360256:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.360270:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.360304:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.360313:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.360336:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857299.360353:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.360359:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.361151:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.361156:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.361167:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.361186:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.361193:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006751b7fe/0xf326646fe3bbfb1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.361214:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.361223:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.361224:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.366349:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.366363:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.366865:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.366869:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.366877:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.366892:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.366902:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.366910:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.367287:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787857299.367446:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.367460:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.367470:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737200 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.367475:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.367484:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.367502:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.367510:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000805a3111/0xf326646fe3bbfb21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.367531:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.367533:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.367534:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787857299.367981:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787857299.368994:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.369003:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369088:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.369092:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.369098:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369118:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369127:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369134:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369193:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.369643:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.369650:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369681:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.369685:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.369689:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369697:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369706:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.369722:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370327:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857299.370336:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370345:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857299.370349:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370358:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370397:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370405:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5bd24f2/0xf326646fe3bbfb28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370429:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857299.370432:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370439:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857299.370442:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370461:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370472:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.370480:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857299.370482:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857299.370484:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.370726:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.370733:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017e17fba/0xf326646fe3bbfb2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.370835:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.373829:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.373845:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373862:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.373866:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.373873:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373886:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373896:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373904:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373938:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787857299.373957:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787857299.373963:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373972:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857299.373976:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.373986:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.374003:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.374085:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000533dc297/0xf326646fe3bbfb36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.374108:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.374110:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.374111:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.375181:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.375189:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375201:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.375212:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.375217:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375228:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375238:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375246:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375314:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.375774:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.375780:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375790:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.375793:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.375798:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375807:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375815:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.375828:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378137:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787857299.378152:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378166:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857299.378171:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378183:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378204:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378213:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025da35c6/0xf326646fe3bbfb3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378254:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787857299.378258:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378265:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857299.378269:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378276:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378286:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857299.378302:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857299.378304:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857299.378306:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.380010:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.380025:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000752e7a96/0xf326646fe3bbfb44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.380392:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787857299.381141:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.381150:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381164:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.381169:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.381176:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381188:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381198:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381205:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381282:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787857299.381762:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.381769:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381778:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.381781:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.381785:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381794:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381803:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.381819:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382275:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787857299.382304:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382314:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.382318:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382341:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382359:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382367:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc655661/0xf326646fe3bbfb4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382388:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.382391:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382397:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737000 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.382400:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382407:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382417:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.382423:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.382425:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.382433:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.382547:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.382553:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ada66ed/0xf326646fe3bbfb52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857299.383511:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.383519:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.383550:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.383554:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.383560:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.383571:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.383582:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.383590:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.383806:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.384145:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.384155:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.384159:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.384169:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.384185:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.384196:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.384197:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.384199:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.384273:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.384279:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f076b359/0xf326646fe3bbfb59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787857299.385260:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787857299.385268:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.385300:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787857299.385305:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857299.385311:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.385337:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.385347:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857299.385355:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385454:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857299.385460:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385468:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857299.385471:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385480:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385505:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385513:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.385515:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857299.385517:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857299.385764:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787857299.385770:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046564261/0xf326646fe3bbfb60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857299.385923:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787857299.386159:0:14998:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787857299.386369:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14339:x1874703885107584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 99611us (99795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857299.386381:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857299.386468:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14339:1874703885107584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787857299.386485:0:14339:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787857299.386529:0:14339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14339:1874703885107712:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787857299.386996:0:14339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857299.387072:0:14339:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ea019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857299.387107:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107712 00000100:00100000:0.0:1787857299.387113:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107712 00000100:00100000:0.0:1787857299.387185:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787857299.387195:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14339:x1874703885107712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787857299.387232:0:14996:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787857299.398077:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14339:x1874703885107712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10873us (11070us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787857299.398091:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787857299.398522:0:14339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14339:1874703885107712:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787857299.398584:0:14339:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787857300.173907:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787857300.490133:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787857301.197312:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787857301.306102:0:16070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787857302.218448:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857302.859866:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885107840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857302.859945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857302.860082:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107840 00000100:00100000:2.0:1787857302.860090:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107840 00000100:00100000:2.0:1787857302.860164:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857302.860175:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885107840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787857302.860218:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787857302.860301:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787857302.862534:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885107840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2356us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857302.862547:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787857302.863829:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885107840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787857303.240081:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857303.539026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857303.544388:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094528 00000100:00100000:2.0:1787857303.544408:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094528 00000100:00100000:3.0:1787857303.548157:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:3.0:1787857303.548169:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1874703863094528:12345-192.168.204.29@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787857303.548203:0:14307:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 77fe3580-dc54-49f7-8e5a-5b39c991850c@192.168.204.29@tcp t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:3.0:1787857303.548250:0:14307:0:(genops.c:1385:class_connect()) connect: client 77fe3580-dc54-49f7-8e5a-5b39c991850c, cookie 0xf326646fe3bbfb67 00000100:00080000:3.0:1787857303.548401:0:14307:0:(import.c:65:import_set_state_nolock()) ffff9fd97fbff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857303.548483:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+5:2351:x1874703863094528:12345-192.168.204.29@tcp:250:mount.lustre.0 Request processed in 314us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.548491:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 75 00000100:00100000:2.0:1787857303.557911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.561050:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094656 00000100:00100000:3.0:1787857303.561066:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094656 00000100:00100000:3.0:1787857303.561168:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:3.0:1787857303.561181:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+5:13748:x1874703863094656:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787857303.561200:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857303.561238:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd843736400/0xf326646fe3bbfb6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bf2 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.561268:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd843736400/0xf326646fe3bbfb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bf2 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.561279:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd843736400/0xf326646fe3bbfb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bf2 expref: 6 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.561289:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843736400, rc 0) 00000100:00100000:3.0:1787857303.561368:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+6:13748:x1874703863094656:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 189us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.561394:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 76 00000100:00100000:2.0:1787857303.565681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.565827:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094784 00000100:00100000:0.0:1787857303.565837:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094784 00000100:00100000:0.0:1787857303.565890:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1787857303.565900:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+6:13748:x1874703863094784:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787857303.566186:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+6:13748:x1874703863094784:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 286us (529us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787857303.566193:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 77 00000100:00100000:0.0:1787857303.569956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.570050:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863094912 00000100:00100000:3.0:1787857303.570061:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863094912 00000100:00100000:3.0:1787857303.570159:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:3.0:1787857303.570169:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+6:13748:x1874703863094912:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787857303.570187:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857303.570206:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd843736800/0xf326646fe3bbfb75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882bf9 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.570254:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd843736800/0xf326646fe3bbfb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bf9 expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.570266:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd843736800/0xf326646fe3bbfb75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882bf9 expref: 7 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.570275:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843736800, rc 0) 00000100:00100000:3.0:1787857303.570338:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+7:13748:x1874703863094912:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.570346:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 78 00000100:00100000:2.0:1787857303.575503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857303.578364:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095040 00000100:00100000:1.0:1787857303.578380:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095040 00000100:00100000:1.0:1787857303.578442:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:1.0:1787857303.578451:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+7:13748:x1874703863095040:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787857303.583507:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13748:x1874703863095040:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 5045us (8001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.583587:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 79 00000100:00100000:2.0:1787857303.587793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.587938:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095168 00000100:00100000:3.0:1787857303.587949:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095168 00000100:00100000:3.0:1787857303.588009:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1787857303.588019:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13748:x1874703863095168:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787857303.588267:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975351050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13748:x1874703863095168:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 249us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.588276:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 80 00000100:00100000:3.0:1787857303.593964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.594242:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095296 00000100:00100000:0.0:1787857303.594254:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095296 00000100:00100000:0.0:1787857303.594309:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:0.0:1787857303.594321:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13767:x1874703863095296:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857303.594615:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13767:x1874703863095296:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 295us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.594624:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 81 00000100:00100000:2.0:1787857303.623137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.623336:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095424 00000100:00100000:0.0:1787857303.623346:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095424 00000100:00100000:0.0:1787857303.623405:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:0.0:1787857303.623416:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13767:x1874703863095424:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857303.626913:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13767:x1874703863095424:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 3489us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.626927:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 82 00000100:00100000:2.0:1787857303.639900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.640257:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095552 00000100:00100000:3.0:1787857303.640268:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095552 00000100:00100000:3.0:1787857303.640330:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:3.0:1787857303.640342:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+8:13748:x1874703863095552:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787857303.640360:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857303.640379:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd843737000/0xf326646fe3bbfb7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c23 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.640409:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd843737000/0xf326646fe3bbfb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c23 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.640420:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd843737000/0xf326646fe3bbfb7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c23 expref: 9 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857303.640430:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843737000, rc 0) 00000100:00100000:3.0:1787857303.640496:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+9:13748:x1874703863095552:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 156us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.640504:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 83 00000100:00100000:1.0:1787857303.644277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.644380:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095680 00000100:00100000:0.0:1787857303.644391:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095680 00000100:00100000:0.0:1787857303.644445:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:0.0:1787857303.644455:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+9:13748:x1874703863095680:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787857303.644497:0:14307:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787857303.644736:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787857303.644740:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787857303.644744:0:14307:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787857303.644746:0:14307:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787857303.646258:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+9:13748:x1874703863095680:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 1797us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.646271:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 84 00000100:00100000:2.0:1787857303.660277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.660377:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095808 00000100:00100000:0.0:1787857303.660387:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095808 00000100:00100000:0.0:1787857303.660442:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:0.0:1787857303.660452:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+9:13748:x1874703863095808:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787857303.660470:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857303.660489:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c2a expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857303.660534:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857303.660547:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 10 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857303.660557:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c3400, rc 0) 00000100:00100000:0.0:1787857303.660864:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13748:x1874703863095808:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 413us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.660873:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 85 00000100:00100000:1.0:1787857303.663057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.663162:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863095936 00000100:00100000:0.0:1787857303.663188:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863095936 00000100:00100000:0.0:1787857303.663255:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:0.0:1787857303.663266:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13748:x1874703863095936:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787857303.664967:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13748:x1874703863095936:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 1695us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.664978:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 86 00000100:00100000:2.0:1787857303.671401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.671526:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096064 00000100:00100000:0.0:1787857303.671539:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096064 00000100:00100000:0.0:1787857303.671644:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:0.0:1787857303.671655:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13748:x1874703863096064:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787857303.671963:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13748:x1874703863096064:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 309us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.671971:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 87 00000100:00100000:2.0:1787857303.683015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.683697:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096192 00000100:00100000:0.0:1787857303.683707:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096192 00000100:00100000:0.0:1787857303.683830:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:0.0:1787857303.683841:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13772:x1874703863096192:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857303.684100:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13772:x1874703863096192:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 260us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.684110:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 88 00000100:00100000:1.0:1787857303.700341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.700639:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096320 00000100:00100000:0.0:1787857303.700648:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096320 00000100:00100000:0.0:1787857303.707895:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:0.0:1787857303.707916:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13772:x1874703863096320:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857303.708186:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13772:x1874703863096320:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 278us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.708201:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 89 00000100:00100000:2.0:1787857303.717921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.720963:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096448 00000100:00100000:3.0:1787857303.720980:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096448 00000100:00100000:3.0:1787857303.721035:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1787857303.721045:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1874703863096448:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787857303.721079:0:14314:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from d3457722-5072-4545-bc79-4670e7583e8a@192.168.204.29@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1787857303.721134:0:14314:0:(genops.c:1385:class_connect()) connect: client d3457722-5072-4545-bc79-4670e7583e8a, cookie 0xf326646fe3bbfb8a 00000004:00100000:3.0:1787857303.721168:0:14314:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787857303.721174:0:14314:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787857303.830013:0:14314:0:(import.c:65:import_set_state_nolock()) ffff9fd97fb9d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787857303.830099:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+6:2351:x1874703863096448:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 109053us (112188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.830110:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:2.0:1787857303.840164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857303.840222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857303.840338:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096576 00000100:00100000:1.0:1787857303.840348:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096576 00000100:00100000:1.0:1787857303.840425:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096704 00000100:00100000:1.0:1787857303.840429:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096704 00000100:00100000:1.0:1787857303.840449:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857303.840459:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:0:x1874703863096576:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787857303.840502:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787857303.840602:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:0:x1874703863096576:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 143us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857303.840609:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857303.840627:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1787857303.840634:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863096704:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787857303.840645:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787857303.840697:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863096704:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857303.840722:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00080000:2.0:1787857303.840963:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857303.849759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857303.849798:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096832 00000100:00100000:0.0:1787857303.849809:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096832 00000100:00100000:0.0:1787857303.849876:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:0.0:1787857303.849888:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863096832:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787857303.849984:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863096832:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857303.849992:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857303.856346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857303.856388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857303.856492:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863096960 00000100:00100000:2.0:1787857303.856502:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863096960 00000100:00100000:2.0:1787857303.856561:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097088 00000100:00100000:2.0:1787857303.856564:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097088 00000100:00100000:2.0:1787857303.856587:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1787857303.856595:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863096960:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787857303.856628:0:14997:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from d3457722-5072-4545-bc79-4670e7583e8a@192.168.204.29@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1787857303.856694:0:14997:0:(genops.c:1385:class_connect()) connect: client d3457722-5072-4545-bc79-4670e7583e8a, cookie 0xf326646fe3bbfb91 00002000:00100000:2.0:1787857303.856707:0:14997:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d3457722-5072-4545-bc79-4670e7583e8a/ffff9fd975332000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787857303.856718:0:14997:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787857303.857067:0:14997:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787857303.857100:0:14997:0:(import.c:65:import_set_state_nolock()) ffff9fd975335000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857303.857169:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+6:2351:x1874703863096960:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 573us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857303.857190:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:2.0:1787857303.857220:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1787857303.857224:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1874703863097088:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787857303.857241:0:14997:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from d3457722-5072-4545-bc79-4670e7583e8a@192.168.204.29@tcp t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1787857303.857257:0:14997:0:(genops.c:1385:class_connect()) connect: client d3457722-5072-4545-bc79-4670e7583e8a, cookie 0xf326646fe3bbfb98 00002000:00100000:2.0:1787857303.857262:0:14997:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d3457722-5072-4545-bc79-4670e7583e8a/ffff9fd975334000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787857303.857278:0:14997:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787857303.857401:0:14997:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787857303.857417:0:14997:0:(import.c:65:import_set_state_nolock()) ffff9fd975330800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787857303.857442:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+6:2351:x1874703863097088:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 215us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857303.857449:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1787857303.867052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857303.867173:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097216 00000100:00100000:3.0:1787857303.867182:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097216 00000100:00100000:3.0:1787857303.867252:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1787857303.867264:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863097216:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787857303.868616:0:14317:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1278us 00000004:00200000:3.0:1787857303.908880:0:14317:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787857303.909065:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+6:13748:x1874703863097216:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 41798us (42019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857303.909077:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1787857304.160424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857304.160513:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097344 00000100:00100000:0.0:1787857304.160524:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097344 00000100:00100000:0.0:1787857304.160592:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1787857304.160602:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+6:13793:x1874703863097344:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:0.0:1787857304.160623:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857304.160649:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3c00/0xf326646fe3bbfb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c54 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.160737:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.160750:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.160763:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857304.160956:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787857304.160960:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857304.161046:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.161073:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3c00/0xf326646fe3bbfb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c54 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.161090:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c54 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857304.161099:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:0.0:1787857304.161101:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857304.161105:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2a00, rc 0) 00000100:00100000:0.0:1787857304.161412:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+7:13793:x1874703863097344:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 810us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857304.161421:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00010000:00010000:0.0:1787857304.264293:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857304.394487:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787857304.394514:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885107968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787857304.394597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.394823:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885108224:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.394854:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.394874:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787857304.394879:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885108096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.394905:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.394923:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885108608:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.394942:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.394962:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885108480:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.394987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.395001:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787857304.395006:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885108352:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857304.395058:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108608 00000100:00100000:1.0:1787857304.395065:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108608 00000100:00100000:1.0:1787857304.395117:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108480 00000100:00100000:1.0:1787857304.395120:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108480 00000100:00100000:1.0:1787857304.395135:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108352 00000100:00100000:1.0:1787857304.395138:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108352 00000100:00100000:1.0:1787857304.395153:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857304.395161:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885108608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395238:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874703885108608:12345-0@lo:400:kworker.0 Request processed in 77us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857304.395266:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787857304.395285:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857304.395291:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885108480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395339:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874703885108480:12345-0@lo:400:kworker.0 Request processed in 42us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857304.395345:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857304.395357:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787857304.395363:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885108352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395389:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874703885108352:12345-0@lo:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857304.395395:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787857304.395412:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857304.395445:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874703885108352:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874703885108480:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.395496:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874703885108608:0@lo:400:kworker.0 00000100:00100000:3.0:1787857304.399387:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108096 00000100:00100000:3.0:1787857304.399404:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108096 00000100:00100000:3.0:1787857304.399459:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787857304.399469:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3310:x1874703885108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857304.399565:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3310:x1874703885108096:12345-0@lo:400:kworker.0 Request processed in 99us (4659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857304.399572:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787857304.400917:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885107968 00000100:00100000:2.0:1787857304.400927:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885107968 00000100:00100000:2.0:1787857304.400976:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857304.400985:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885107968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787857304.401009:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857304.401071:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874703885107968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (6474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857304.401077:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787857304.401097:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108224 00000100:00100000:2.0:1787857304.401113:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108224 00000100:00100000:2.0:1787857304.401138:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787857304.401144:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885108224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857304.401216:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b71de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885108224:12345-0@lo:400:kworker.0 Request processed in 73us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857304.401223:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787857304.402261:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787857304.402268:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857304.402312:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885108096:0@lo:400:kworker.0 00000100:00100000:1.0:1787857304.402336:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885108224:0@lo:400:kworker.0 00000100:00100000:3.0:1787857304.405192:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885107968:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787857304.552338:0:7626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787857304.552358:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787857304.552365:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d3457722-5072-4545-bc79-4670e7583e8a 00010000:00010000:1.0:1787857305.287931:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787857305.973260:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d3457722-5072-4545-bc79-4670e7583e8a 00000100:00100000:2.0:1787857306.239061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857306.239173:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097472 00000100:00100000:1.0:1787857306.239183:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097472 00000100:00100000:1.0:1787857306.239265:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:1.0:1787857306.239276:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:13846:x1874703863097472:12345-192.168.204.29@tcp:41:lfs.0 00000004:00000024:1.0:1787857306.239324:0:14316:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787857306.239421:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:13846:x1874703863097472:12345-192.168.204.29@tcp:41:lfs.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857306.239429:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00080000:2.0:1787857306.239770:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857306.245465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.245572:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097600 00000100:00100000:0.0:1787857306.245583:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097600 00000100:00100000:0.0:1787857306.245692:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:0.0:1787857306.245705:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3457722-5072-4545-bc79-4670e7583e8a+5:13846:x1874703863097600:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:0.0:1787857306.245753:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857306.245844:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3457722-5072-4545-bc79-4670e7583e8a+5:13846:x1874703863097600:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 142us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.245852:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00080000:2.0:1787857306.245988:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857306.248143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857306.248747:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097728 00000100:00100000:2.0:1787857306.248761:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097728 00000100:00100000:2.0:1787857306.248840:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1787857306.248850:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3457722-5072-4545-bc79-4670e7583e8a+5:13846:x1874703863097728:12345-192.168.204.29@tcp:13:lfs.0 00002000:00000024:2.0:1787857306.249006:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787857306.249100:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d3457722-5072-4545-bc79-4670e7583e8a+5:13846:x1874703863097728:12345-192.168.204.29@tcp:13:lfs.0 Request processed in 250us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857306.249107:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00080000:1.0:1787857306.249764:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787857306.311938:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857306.512945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.513033:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097856 00000100:00100000:3.0:1787857306.513044:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097856 00000100:00100000:3.0:1787857306.513115:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:3.0:1787857306.513126:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+10:13878:x1874703863097856:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787857306.513144:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857306.513186:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd843737800/0xf326646fe3bbfbad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c5b expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857306.513229:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd843737800/0xf326646fe3bbfbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c5b expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857306.513242:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd843737800/0xf326646fe3bbfbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c5b expref: 11 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857306.513251:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843737800, rc 0) 00000100:00100000:3.0:1787857306.513317:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863097856:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 193us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.513325:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 91 00000100:00100000:3.0:1787857306.521419:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.521591:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863097984 00000100:00100000:0.0:1787857306.521602:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863097984 00000100:00100000:0.0:1787857306.521700:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:0.0:1787857306.521711:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863097984:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787857306.522142:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863097984:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 431us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.522152:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 92 00000100:00100000:1.0:1787857306.527641:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.528683:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098112 00000100:00100000:0.0:1787857306.528696:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098112 00000100:00100000:0.0:1787857306.528771:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:0.0:1787857306.528782:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863098112:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787857306.529174:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863098112:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 393us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.529187:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 93 00000100:00100000:1.0:1787857306.539504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.540374:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098240 00000100:00100000:3.0:1787857306.540384:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098240 00000100:00100000:3.0:1787857306.540440:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:3.0:1787857306.540449:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13885:x1874703863098240:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787857306.540921:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13885:x1874703863098240:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 471us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.540930:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 94 00000100:00100000:3.0:1787857306.569141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857306.570708:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098368 00000100:00100000:2.0:1787857306.570722:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098368 00000100:00100000:2.0:1787857306.570798:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:2.0:1787857306.570808:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13885:x1874703863098368:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787857306.571139:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13885:x1874703863098368:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 331us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857306.571148:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 95 00000100:00100000:1.0:1787857306.578376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.578764:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098496 00000100:00100000:0.0:1787857306.578775:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098496 00000100:00100000:0.0:1787857306.578842:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:0.0:1787857306.578852:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13878:x1874703863098496:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787857306.578869:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857306.578887:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c2200/0xf326646fe3bbfbb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c85 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.578915:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c2200/0xf326646fe3bbfbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c85 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.578945:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c2200/0xf326646fe3bbfbb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c85 expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.578953:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2200, rc 0) 00000100:00100000:0.0:1787857306.579012:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13878:x1874703863098496:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 162us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.579019:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 96 00000100:00100000:1.0:1787857306.585784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.586925:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098624 00000100:00100000:3.0:1787857306.586939:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098624 00000100:00100000:3.0:1787857306.587009:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:3.0:1787857306.587020:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13878:x1874703863098624:12345-192.168.204.29@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787857306.587188:0:14309:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787857306.587287:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787857306.587291:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787857306.587294:0:14309:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787857306.587296:0:14309:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787857306.591292:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13878:x1874703863098624:12345-192.168.204.29@tcp:256:mount.lustre.0 Request processed in 4261us (5506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857306.591307:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 97 00000100:00100000:1.0:1787857306.594501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857306.594724:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098752 00000100:00100000:2.0:1787857306.594735:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098752 00000100:00100000:2.0:1787857306.594789:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:2.0:1787857306.594816:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13878:x1874703863098752:12345-192.168.204.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787857306.594838:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857306.594858:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882c8c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857306.594890:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857306.594902:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857306.594917:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85800, rc 0) 00000100:00100000:2.0:1787857306.594986:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13878:x1874703863098752:12345-192.168.204.29@tcp:101:mount.lustre.0 Request processed in 173us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857306.594994:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 98 00000100:00100000:2.0:1787857306.596875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857306.597112:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863098880 00000100:00100000:1.0:1787857306.597122:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863098880 00000100:00100000:1.0:1787857306.597282:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:1.0:1787857306.597293:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13878:x1874703863098880:12345-192.168.204.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787857306.598732:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13878:x1874703863098880:12345-192.168.204.29@tcp:501:mount.lustre.0 Request processed in 741us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857306.598748:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 99 00000100:00100000:3.0:1787857306.601385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.601685:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099008 00000100:00100000:0.0:1787857306.601695:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099008 00000100:00100000:0.0:1787857306.601751:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:0.0:1787857306.601761:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9759ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13878:x1874703863099008:12345-192.168.204.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787857306.602326:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9759ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13878:x1874703863099008:12345-192.168.204.29@tcp:503:mount.lustre.0 Request processed in 564us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.602335:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 100 00000100:00100000:0.0:1787857306.607209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857306.607415:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099136 00000100:00100000:1.0:1787857306.607425:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099136 00000100:00100000:1.0:1787857306.607503:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:1.0:1787857306.607523:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13888:x1874703863099136:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787857306.607889:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13888:x1874703863099136:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 376us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857306.607898:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 101 00000100:00100000:2.0:1787857306.612178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.612349:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099264 00000100:00100000:0.0:1787857306.612361:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099264 00000100:00100000:0.0:1787857306.612429:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:0.0:1787857306.612440:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13888:x1874703863099264:12345-192.168.204.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787857306.613134:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13888:x1874703863099264:12345-192.168.204.29@tcp:502:llog_process_th.0 Request processed in 692us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.613144:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 102 00000100:00100000:3.0:1787857306.621381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.621768:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099392 00000100:00100000:0.0:1787857306.621781:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099392 00000100:00100000:0.0:1787857306.621904:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857306.621932:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1874703863099392:12345-192.168.204.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787857306.621966:0:14315:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 6427da80-861e-4a71-8198-a1d68c83b701@192.168.204.29@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1787857306.622015:0:14315:0:(genops.c:1385:class_connect()) connect: client 6427da80-861e-4a71-8198-a1d68c83b701, cookie 0xf326646fe3bbfbc2 00000004:00100000:0.0:1787857306.622067:0:14315:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787857306.622245:0:14315:0:(import.c:65:import_set_state_nolock()) ffff9fd945d85800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787857306.622340:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6427da80-861e-4a71-8198-a1d68c83b701+6:2351:x1874703863099392:12345-192.168.204.29@tcp:38:mount.lustre.0 Request processed in 409us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.622350:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:2.0:1787857306.626818:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857306.626859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.626944:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099520 00000100:00100000:3.0:1787857306.626955:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099520 00000100:00100000:3.0:1787857306.627042:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099648 00000100:00100000:3.0:1787857306.627046:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099648 00000100:00100000:3.0:1787857306.627066:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1787857306.627077:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+7:0:x1874703863099520:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787857306.627110:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787857306.627195:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+7:0:x1874703863099520:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.627214:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1787857306.627234:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:3.0:1787857306.627241:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863099648:12345-192.168.204.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787857306.627252:0:14314:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787857306.627275:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863099648:12345-192.168.204.29@tcp:41:mount.lustre.0 Request processed in 35us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.627282:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00080000:2.0:1787857306.628301:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857306.630994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.631198:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099776 00000100:00100000:3.0:1787857306.631286:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099776 00000100:00100000:3.0:1787857306.631400:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1787857306.631411:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863099776:12345-192.168.204.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787857306.631532:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863099776:12345-192.168.204.29@tcp:40:mount.lustre.0 Request processed in 122us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.631554:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1787857306.640024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.640077:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.640104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857306.640314:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863099904 00000100:00100000:3.0:1787857306.640324:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863099904 00000100:00100000:3.0:1787857306.640366:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100032 00000100:00100000:3.0:1787857306.640369:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100032 00000100:00100000:3.0:1787857306.640382:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857306.640392:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874703863099904:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787857306.640425:0:14998:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 6427da80-861e-4a71-8198-a1d68c83b701@192.168.204.29@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1787857306.640469:0:14998:0:(genops.c:1385:class_connect()) connect: client 6427da80-861e-4a71-8198-a1d68c83b701, cookie 0xf326646fe3bbfbc9 00002000:00100000:3.0:1787857306.640483:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6427da80-861e-4a71-8198-a1d68c83b701/ffff9fd97a621000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857306.640495:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857306.640868:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787857306.640917:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9fd97535c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857306.640987:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb59a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6427da80-861e-4a71-8198-a1d68c83b701+6:2351:x1874703863099904:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 595us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.640996:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857306.641017:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1787857306.641022:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1874703863100032:12345-192.168.204.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787857306.641040:0:14998:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 6427da80-861e-4a71-8198-a1d68c83b701@192.168.204.29@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1787857306.641075:0:14998:0:(genops.c:1385:class_connect()) connect: client 6427da80-861e-4a71-8198-a1d68c83b701, cookie 0xf326646fe3bbfbd0 00002000:00100000:3.0:1787857306.641081:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6427da80-861e-4a71-8198-a1d68c83b701/ffff9fd975359000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113951 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787857306.641088:0:14998:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787857306.641803:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787857306.641826:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9fd95079a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787857306.641891:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6427da80-861e-4a71-8198-a1d68c83b701+6:2351:x1874703863100032:12345-192.168.204.29@tcp:8:mount.lustre.0 Request processed in 867us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857306.641899:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:2.0:1787857306.642142:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100160 00000100:00100000:2.0:1787857306.642149:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100160 00000100:00100000:2.0:1787857306.642235:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1787857306.642244:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863100160:12345-192.168.204.29@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787857306.642513:0:14318:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787857306.643387:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6427da80-861e-4a71-8198-a1d68c83b701+6:13878:x1874703863100160:12345-192.168.204.29@tcp:33:mount.lustre.0 Request processed in 1140us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857306.643405:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:2.0:1787857306.783429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857306.783642:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100288 00000100:00100000:0.0:1787857306.783652:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100288 00000100:00100000:0.0:1787857306.783791:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:0.0:1787857306.783803:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6427da80-861e-4a71-8198-a1d68c83b701+6:13909:x1874703863100288:12345-192.168.204.29@tcp:101:mkdir.0 00010000:00010000:0.0:1787857306.783951:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857306.783978:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3c00/0xf326646fe3bbfbd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cb6 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.784136:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.784340:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.784357:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857306.785939:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787857306.785948:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857306.786047:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.786090:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3c00/0xf326646fe3bbfbd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.786109:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857306.786117:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:0.0:1787857306.786120:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787857306.786123:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c3600, rc 0) 00000100:00100000:0.0:1787857306.786214:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd843e392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6427da80-861e-4a71-8198-a1d68c83b701+7:13909:x1874703863100288:12345-192.168.204.29@tcp:101:mkdir.0 Request processed in 2412us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857306.786222:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:1.0:1787857307.337194:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857307.976836:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787857307.976863:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885108736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857307.976937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857307.976982:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108736 00000100:00100000:0.0:1787857307.976990:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108736 00000100:00100000:0.0:1787857307.977060:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787857307.977070:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885108736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857307.977104:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787857307.977119:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857307.977242:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885108736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857307.977251:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787857307.977804:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885108736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787857308.360031:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787857309.116464:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6427da80-861e-4a71-8198-a1d68c83b701 00000001:00100000:2.0:1787857309.116481:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d3457722-5072-4545-bc79-4670e7583e8a 00010000:00010000:1.0:1787857309.384990:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857309.512112:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787857309.512141:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885108864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787857309.512240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.512834:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885109248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.512873:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.512900:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857309.512906:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885109120:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.512932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.512960:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885109376:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.512983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.513003:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787857309.513008:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885108992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513035:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.513058:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885109504:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513079:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857309.513120:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885109248 00000100:00100000:1.0:1787857309.513128:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885109248 00000100:00100000:1.0:1787857309.513166:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885109376 00000100:00100000:1.0:1787857309.513170:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885109376 00000100:00100000:1.0:1787857309.513196:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885109504 00000100:00100000:1.0:1787857309.513200:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885109504 00000100:00100000:1.0:1787857309.513215:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857309.513232:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885109248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513283:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd951550b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885109248:12345-0@lo:400:kworker.0 Request processed in 52us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857309.513290:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787857309.513308:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857309.513313:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885109376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513339:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874703885109376:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857309.513344:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787857309.513355:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787857309.513360:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885109504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513380:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885109504:12345-0@lo:400:kworker.0 Request processed in 21us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857309.513385:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787857309.513403:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108992 00000100:00100000:1.0:1787857309.513406:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108992 00000100:00100000:1.0:1787857309.513430:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787857309.513437:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3311:x1874703885108992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513466:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3311:x1874703885108992:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857309.513472:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1787857309.513498:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857309.513526:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885109248:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513565:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885108992:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513574:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885109504:0@lo:400:kworker.0 00000100:00100000:1.0:1787857309.513594:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874703885109376:0@lo:400:kworker.0 00000100:00100000:0.0:1787857309.529797:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885108864 00000100:00100000:0.0:1787857309.529813:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885108864 00000100:00100000:0.0:1787857309.529893:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787857309.529903:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885108864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787857309.529951:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857309.530048:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885108864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (17808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857309.530055:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787857309.530151:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857309.530184:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787857309.530210:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885108864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857309.534844:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885109120 00000100:00100000:2.0:1787857309.534858:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885109120 00000100:00100000:2.0:1787857309.534925:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787857309.534936:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885109120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857309.535036:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b765680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885109120:12345-0@lo:400:kworker.0 Request processed in 101us (22101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857309.535043:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787857309.535707:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857309.536880:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b71e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885109120:0@lo:400:kworker.0 00000001:00100000:1.0:1787857309.597614:0:7626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6427da80-861e-4a71-8198-a1d68c83b701 00000001:02000400:2.0:1787857309.951982:0:16276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787857310.408158:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787857310.728326:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1787857311.118431:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6427da80-861e-4a71-8198-a1d68c83b701 00010000:00010000:1.0:1787857311.431946:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787857312.102678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857312.102735:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857312.104306:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100544 00000100:00100000:2.0:1787857312.104321:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100544 00000100:00100000:2.0:1787857312.104397:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:2.0:1787857312.104410:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:2355:x1874703863100544:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:2.0:1787857312.104500:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:2355:x1874703863100544:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 93us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857312.104508:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00080000:2.0:1787857312.104533:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787857312.105006:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100416 00000100:00100000:0.0:1787857312.105012:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100416 00000100:00100000:0.0:1787857312.105043:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:0.0:1787857312.105062:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2355:x1874703863100416:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857312.105109:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2355:x1874703863100416:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 49us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857312.105116:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 104 00000100:00100000:0.0:1787857312.114566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857312.114610:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857312.114655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857312.114728:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100672 00000100:00100000:1.0:1787857312.114738:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100672 00000100:00100000:1.0:1787857312.114798:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100800 00000100:00100000:1.0:1787857312.114801:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100800 00000100:00100000:1.0:1787857312.114816:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101056 00000100:00100000:1.0:1787857312.114819:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101056 00000100:00100000:1.0:1787857312.114834:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1787857312.114843:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2355:x1874703863100672:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857312.114911:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2355:x1874703863100672:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 69us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857312.114918:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1787857312.114934:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857312.114939:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2354:x1874703863100800:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857312.114957:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2354:x1874703863100800:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 18us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857312.114963:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:1.0:1787857312.114971:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1787857312.114976:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2354:x1874703863101056:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:1.0:1787857312.115003:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2354:x1874703863101056:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857312.115009:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00080000:0.0:1787857312.115308:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787857312.115314:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857312.117133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857312.117211:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863100928 00000100:00100000:3.0:1787857312.117221:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863100928 00000100:00100000:3.0:1787857312.117328:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:3.0:1787857312.117339:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:2355:x1874703863100928:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857312.117423:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:2355:x1874703863100928:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 86us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857312.117432:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00080000:0.0:1787857312.117482:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857312.122377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857312.122736:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101184 00000100:00100000:3.0:1787857312.122747:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101184 00000100:00100000:3.0:1787857312.122822:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:3.0:1787857312.122833:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2355:x1874703863101184:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:3.0:1787857312.122905:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2355:x1874703863101184:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 75us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857312.122913:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00080000:1.0:1787857312.123063:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787857312.457885:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857313.096808:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787857313.096832:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885109632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787857313.096904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857313.096985:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885109632 00000100:00100000:0.0:1787857313.096993:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885109632 00000100:00100000:0.0:1787857313.097056:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787857313.097066:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885109632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857313.097103:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857313.097149:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885109632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857313.097157:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787857313.097177:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787857313.097212:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885109632:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787857313.402379:0:16425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe19645d40 20000000:00000080:1.0:1787857313.402470:0:16425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fd842b90800 uarg=0000000000000000 20000000:01000000:1.0:1787857313.402509:0:16425:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787857313.402514:0:16425:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787857313.402519:0:16425:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787857313.403873:0:16426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787857313.404131:0:16425:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787857313.413940:0:16425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787857313.413974:0:16425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.413996:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.414003:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.414010:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.414019:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.414036:0:16425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.414055:0:16425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.414289:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 12 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.414316:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 12 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.414397:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd843e39680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885109760:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857313.414513:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.414521:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.414529:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885109888:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857313.414559:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.414565:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857313.417195:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857313.417263:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101312 00000100:00100000:1.0:1787857313.417272:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101312 00010000:00010000:1.0:1787857313.417317:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 13 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.417361:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1787857313.417371:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2352:x1874703863101312:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857313.417385:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857313.417396:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 13 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.417992:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110016:0@lo:104: 00000100:00100000:2.0:1787857313.418463:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857313.418509:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110016 00000100:00100000:3.0:1787857313.418527:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110016 00000100:00100000:0.0:1787857313.418628:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787857313.418639:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:16425:x1874703885110016:12345-0@lo:104: 00010000:00010000:0.0:1787857313.418691:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.418752:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787857313.418758:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:16425:x1874703885110016:12345-0@lo:104: Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857313.418766:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787857313.418808:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 13 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.418808:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787857313.418815:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.418821:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c3800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857313.418825:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.418835:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857313.418836:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787857313.418848:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857313.418853:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787857313.418874:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2352:x1874703863101312:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 1505us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857313.418881:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:0.0:1787857313.418885:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.418891:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787857313.418950:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.418961:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.418971:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110272:0@lo:104: 00000100:00100000:2.0:1787857313.418997:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857313.419049:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.419057:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3800/0xf326646fe3bbfa5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbfa64 expref: -99 pid: 15713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.419070:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.419072:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.419074:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787857313.419076:0:16425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.419085:0:16425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 18 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.419091:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885110144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857313.419092:0:16425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110400:0@lo:104: 00000100:00100000:2.0:1787857313.419116:0:16425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857313.419117:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857313.419153:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110144 00000100:00100000:0.0:1787857313.419157:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110144 00010000:00010000:0.0:1787857313.419173:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 19 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.419192:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787857313.419198:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3310:x1874703885110144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787857313.419212:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857313.419216:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 19 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.419230:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 19 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.419240:0:16425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d41300 going to sleep for 11 seconds 00010000:00010000:0.0:1787857313.419253:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857313.419260:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97fa85800/0xf326646fe3bbfbbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c8c expref: 12 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.419271:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd843e39680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885109760:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857313.419278:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3310:x1874703885110144:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857313.419282:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a4bd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885109888:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857313.419285:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787857313.419289:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97c2c2c00/0xf326646fe3bbfa64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbfa5d expref: 19 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.419296:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110016:0@lo:104: 00000100:00100000:0.0:1787857313.419308:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64833f6a-f420-4926-9238-fdfd3153a5b1:3310:1874703885110144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857313.419701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857313.421017:0:14297:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787857313.421049:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110272 00000100:00100000:1.0:1787857313.421057:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110272 00000100:00100000:1.0:1787857313.421100:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110400 00000100:00100000:1.0:1787857313.421103:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110400 00000100:00100000:1.0:1787857313.421240:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787857313.421252:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+4:16425:x1874703885110272:12345-0@lo:104: 00010000:00010000:1.0:1787857313.421285:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.421513:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101440 00000100:00100000:0.0:1787857313.421518:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101440 00010000:00010000:0.0:1787857313.421542:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421550:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787857313.421556:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+4:16425:x1874703885110272:12345-0@lo:104: Request processed in 308us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857313.421561:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:1.0:1787857313.421563:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787857313.421567:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:2352:x1874703863101440:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857313.421577:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857313.421581:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.421592:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787857313.421593:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.421598:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd948138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:16425:x1874703885110400:12345-0@lo:104: 00010000:00010000:1.0:1787857313.421605:0:14297:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421611:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfb83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c2a expref: 12 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421625:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857313.421639:0:14297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787857313.421644:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd948138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+3:16425:x1874703885110400:12345-0@lo:104: Request processed in 47us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857313.421649:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787857313.421681:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:2352:x1874703863101440:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 114us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857313.421694:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00010000:00010000:1.0:1787857313.421723:0:14302:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787857313.421729:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421729:0:14303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857313.421736:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030800 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:1.0:1787857313.421740:0:14302:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421748:0:14302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787857313.421754:0:14302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787857313.421766:0:14302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787857313.421794:0:14302:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421800:0:14302:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787857313.421817:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421824:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd940030800/0xf326646fe3bbf922 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf929 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421834:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857313.421835:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857313.421837:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857313.421850:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885110528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857313.421880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787857313.421905:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.421911:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421918:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85000 already unused, calling callback (ffffffffc1db5c20) 10000000:00010000:0.0:1787857313.421921:0:14303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.421927:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110528 00010000:00010000:0.0:1787857313.421928:0:14303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.421930:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110528 10000000:00010000:0.0:1787857313.421935:0:14303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787857313.421940:0:14303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787857313.421943:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421957:0:14303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857313.421960:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787857313.421963:0:14303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787857313.421966:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:3311:x1874703885110528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787857313.421973:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857313.421973:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421977:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421980:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.129@tcp lock: ffff9fd97fa85000/0xf326646fe3bbf8d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf326646fe3bbf8dc expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857313.421986:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.421993:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.421995:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.421997:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857313.422003:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857313.422009:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787857313.422010:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857313.422040:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:3311:x1874703885110528:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857313.422047:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787857313.422067:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885110656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787857313.422091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857313.422138:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64833f6a-f420-4926-9238-fdfd3153a5b1:3311:1874703885110528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787857313.422790:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110656 00000100:00100000:0.0:1787857313.422796:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110656 00010000:00010000:0.0:1787857313.422818:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 18 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.422842:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787857313.422845:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f978800/0xf326646fe3bbf929 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf922 expref: 18 pid: 14307 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.422848:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+18:3312:x1874703885110656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787857313.422858:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110272:0@lo:104: 00010000:00010000:0.0:1787857313.422858:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857313.422862:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 17 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857313.422867:0:16425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16425:1874703885110400:0@lo:104: 00010000:00010000:0.0:1787857313.422872:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 17 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.422885:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd940031200/0xf326646fe3bbf8dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf326646fe3bbf8d5 expref: 17 pid: 14309 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.422895:0:16425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.422907:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.422919:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857313.423073:0:14298:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1787857313.429928:0:14299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.429948:0:14299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.429955:0:14299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.429978:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.429984:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857313.429988:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.429995:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.430031:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857313.430044:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787857313.430059:0:16425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.430073:0:16425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857313.430079:0:16425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fd97f978a00/0xf326646fe3bbfbe5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857313.430134:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3312:x1874703885110656:12345-0@lo:103:ldlm_bl.0 Request processed in 7283us (8038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857313.430145:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787857313.430231:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885110656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787857313.481585:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857314.517517:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857314.631860:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787857314.631885:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857314.632619:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885111040:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.632691:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.632696:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885111296:0@lo:400:kworker.0 00000100:00100000:3.0:1787857314.632735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.632787:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787857314.632794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885110912:0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.632809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.632834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857314.632867:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110784 00000100:00100000:3.0:1787857314.632870:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885111424:0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.632874:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110784 00000100:00100000:3.0:1787857314.632898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.632932:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885110912 00000100:00100000:3.0:1787857314.632936:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885110912 00000100:00100000:3.0:1787857314.632972:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787857314.632982:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3309:x1874703885110912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857314.633045:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+16:3309:x1874703885110912:12345-0@lo:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857314.633054:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787857314.633108:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb48780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64833f6a-f420-4926-9238-fdfd3153a5b1:3309:1874703885110912:0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.633485:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787857314.633495:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885110784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857314.633524:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857314.633570:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874703885110784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857314.633576:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787857314.633600:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857314.633611:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111296 00000100:00100000:1.0:1787857314.633615:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111296 00000100:00100000:1.0:1787857314.633648:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111424 00000100:00100000:1.0:1787857314.633652:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111424 00000100:00100000:1.0:1787857314.633725:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857314.633731:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885111296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.633770:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874703885111296:12345-0@lo:400:kworker.0 Request processed in 40us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857314.633777:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787857314.633787:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787857314.633792:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885111424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.633819:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874703885111424:12345-0@lo:400:kworker.0 Request processed in 27us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857314.633824:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787857314.633843:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857314.633865:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874703885111424:0@lo:400:kworker.0 00000100:00100000:1.0:1787857314.633876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874703885111296:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634031:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885111552:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634062:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857314.634079:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787857314.634084:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885111168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857314.634139:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111040 00000100:00100000:2.0:1787857314.634142:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111040 00000100:00100000:2.0:1787857314.634168:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111168 00000100:00100000:2.0:1787857314.634170:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111168 00000100:00100000:2.0:1787857314.634183:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787857314.634188:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885111040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634223:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885111040:12345-0@lo:400:kworker.0 Request processed in 34us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857314.634229:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787857314.634240:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787857314.634245:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885111168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634269:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885111168:12345-0@lo:400:kworker.0 Request processed in 24us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857314.634287:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787857314.634308:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111552 00000100:00100000:2.0:1787857314.634311:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111552 00000100:00100000:2.0:1787857314.634334:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857314.634340:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885111552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634375:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885111552:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857314.634380:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787857314.634529:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885111168:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634540:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885111040:0@lo:400:kworker.0 00000100:00100000:2.0:1787857314.634548:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885111552:0@lo:400:kworker.0 00000100:00080000:1.0:1787857314.634961:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857314.638805:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885110784:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1787857314.887726:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787857314.887734:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd97535c000 from 10 10000000:01000000:0.0:1787857314.887739:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787857314.887788:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857314.887799:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857314.887809:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857314.887836:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787857314.887953:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857314.888022:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946548600 going to sleep for 11 seconds 00000100:00100000:2.0:1787857314.888112:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111680 00000100:00100000:2.0:1787857314.888120:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111680 00000100:00100000:2.0:1787857314.888165:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787857314.888174:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+16:14311:x1874703885111680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857314.888187:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857314.888202:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97fa85000/0xf326646fe3bbfbf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfbec expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.888225:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97fa85000/0xf326646fe3bbfbf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfbec expref: 17 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.888235:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97fa85000/0xf326646fe3bbfbf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfbec expref: 17 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.888402:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85000, rc 0) 00000100:00100000:2.0:1787857314.888727:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885111680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 553us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857314.888735:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787857314.888871:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857314.888894:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfbf3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.888903:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfbf3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857314.888964:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.889144:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.889211:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9604e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787857314.889274:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111808 00000100:00100000:0.0:1787857314.889279:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111808 00000100:00100000:0.0:1787857314.889307:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787857314.889314:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885111808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857314.890132:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885111808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 815us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857314.890140:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787857314.890513:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.890557:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.890612:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.890651:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9604e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787857314.890820:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885111936 00000100:00100000:1.0:1787857314.890827:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885111936 00000100:00100000:1.0:1787857314.890872:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787857314.890882:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885111936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857314.891446:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885111936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 565us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857314.891454:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787857314.891516:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885111936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787857314.892641:0:16494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787857314.893157:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787857314.893185:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787857314.893199:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfbf3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.893211:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97c2c3a00/0xf326646fe3bbfbec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfbf3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787857314.893221:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787857314.893224:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96b886000 from 10 10000000:01000000:3.0:1787857314.893228:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787857314.893266:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.893275:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.893284:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857314.893306:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.893381:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787857314.893438:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd953460780 going to sleep for 11 seconds 00000100:00100000:0.0:1787857314.893554:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112064 00000100:00100000:0.0:1787857314.893562:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112064 00000100:00100000:0.0:1787857314.893612:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787857314.893621:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+17:14311:x1874703885112064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857314.893633:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857314.893648:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c3800/0xf326646fe3bbfc01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfbfa expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857314.893696:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c3800/0xf326646fe3bbfc01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfbfa expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857314.893708:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c3800/0xf326646fe3bbfc01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfbfa expref: 18 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857314.893717:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c3800, rc 0) 00000100:00100000:0.0:1787857314.893765:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857314.893772:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787857314.893857:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787857314.893873:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc01 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857314.893897:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfc01 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857314.893950:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857314.893984:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857314.894023:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946020d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787857314.894499:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112192 00000100:00100000:0.0:1787857314.894514:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112192 00000100:00100000:0.0:1787857314.894551:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787857314.894559:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857314.894852:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857314.894859:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787857314.895875:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787857314.895930:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787857314.896003:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857314.896124:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946020d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787857314.896342:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112320 00000100:00100000:3.0:1787857314.896349:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112320 00000100:00100000:3.0:1787857314.896397:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787857314.896405:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.896604:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857314.896611:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787857314.896838:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b7652c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787857314.898696:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787857314.900022:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787857314.900059:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857314.900075:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc01 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.900089:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd843736000/0xf326646fe3bbfbfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc01 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787857314.900103:0:14311:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787857314.900106:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fd96dd97000 from 10 10000000:01000000:2.0:1787857314.900110:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787857314.900156:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.900163:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.900174:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857314.900204:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787857314.900286:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857314.900340:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857314.900562:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112448 00000100:00100000:3.0:1787857314.900570:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112448 00000100:00100000:3.0:1787857314.900619:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787857314.900629:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+18:14311:x1874703885112448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787857314.900644:0:14309:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857314.900687:0:14309:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd843736600/0xf326646fe3bbfc0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf326646fe3bbfc08 expref: -99 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.900713:0:14309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd843736600/0xf326646fe3bbfc0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf326646fe3bbfc08 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.900723:0:14309:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd843736600/0xf326646fe3bbfc0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf326646fe3bbfc08 expref: 19 pid: 14309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857314.900732:0:14309:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843736600, rc 0) 00000100:00100000:3.0:1787857314.900779:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885112448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857314.900786:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787857314.900910:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787857314.900944:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc0f expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.900958:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf326646fe3bbfc0f expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857314.901126:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857314.901157:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857314.901178:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787857314.901792:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112576 00000100:00100000:0.0:1787857314.901799:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112576 00000100:00100000:0.0:1787857314.901839:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787857314.901849:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885112576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857314.902897:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885112576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1046us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857314.902907:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787857314.902985:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857314.903047:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787857314.903097:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857314.903173:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945d413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857314.903495:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885112704 00000100:00100000:3.0:1787857314.903509:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885112704 00000100:00100000:3.0:1787857314.903641:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787857314.903653:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885112704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787857314.903923:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64833f6a-f420-4926-9238-fdfd3153a5b1+19:14311:x1874703885112704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857314.903930:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787857314.904074:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64833f6a-f420-4926-9238-fdfd3153a5b1:14311:1874703885112704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787857314.906633:0:16496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787857314.911886:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787857314.911928:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787857314.911941:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc0f expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857314.911953:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.129@tcp lock: ffff9fd97fa84000/0xf326646fe3bbfc08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf326646fe3bbfc0f expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857315.299100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857315.316792:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101568 00000100:00100000:0.0:1787857315.316812:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101568 00000100:00100000:0.0:1787857315.316882:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:0.0:1787857315.316892:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+11:13762:x1874703863101568:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857315.316912:0:14308:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857315.316933:0:14308:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfc16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cbd expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.316965:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfc16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cbd expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.317153:0:14308:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c3400/0xf326646fe3bbfc16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cbd expref: 12 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.317165:0:14308:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c3400, rc 0) 00000100:00100000:0.0:1787857315.317248:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101568:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 357us (18157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857315.317256:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 115 00000100:00100000:3.0:1787857315.319598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857315.320067:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101696 00000100:00100000:0.0:1787857315.320076:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101696 00000100:00100000:0.0:1787857315.320130:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1787857315.320139:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd9482a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101696:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787857315.320467:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd9482a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101696:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 320us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857315.320476:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 116 00000100:00100000:0.0:1787857315.328698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857315.328735:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101824 00000100:00100000:0.0:1787857315.328744:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101824 00000100:00100000:0.0:1787857315.328798:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:0.0:1787857315.328808:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101824:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857315.329039:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975519450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101824:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 231us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857315.329047:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 117 00000100:00100000:1.0:1787857315.343879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857315.343964:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863101952 00000100:00100000:0.0:1787857315.343975:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863101952 00000100:00100000:0.0:1787857315.344045:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1787857315.344055:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+12:13762:x1874703863101952:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787857315.344072:0:14307:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857315.344090:0:14307:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fd97c2c3c00/0xf326646fe3bbfc1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cc4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.344131:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fd97c2c3c00/0xf326646fe3bbfc1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cc4 expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.344143:0:14307:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fd97c2c3c00/0xf326646fe3bbfc1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cc4 expref: 13 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857315.344153:0:14307:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c3c00, rc 0) 00000100:00100000:0.0:1787857315.344220:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975518050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13762:x1874703863101952:12345-192.168.204.29@tcp:101:ll_cfg_requeue.0 Request processed in 166us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857315.344228:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 118 00000100:00100000:0.0:1787857315.348015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857315.348167:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102080 00000100:00100000:2.0:1787857315.348178:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102080 00000100:00100000:2.0:1787857315.348239:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:2.0:1787857315.348248:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd975519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13762:x1874703863102080:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787857315.349007:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd975519c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13762:x1874703863102080:12345-192.168.204.29@tcp:501:ll_cfg_requeue.0 Request processed in 755us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857315.349018:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 119 00000100:00100000:2.0:1787857315.360920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857315.361073:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102208 00000100:00100000:0.0:1787857315.361083:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102208 00000100:00100000:0.0:1787857315.361143:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 120 00000100:00100000:0.0:1787857315.361153:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13762:x1874703863102208:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787857315.361379:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:13762:x1874703863102208:12345-192.168.204.29@tcp:503:ll_cfg_requeue.0 Request processed in 226us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857315.361388:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 120 00010000:00010000:1.0:1787857315.532337:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857316.551828:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857316.824939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857316.827916:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102336 00000100:00100000:2.0:1787857316.827931:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102336 00000100:00080000:1.0:1787857316.828085:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857316.828183:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1787857316.828196:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+6:14419:x1874703863102336:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857316.828224:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857316.828251:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ccb expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828335:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828350:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828365:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828378:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828385:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828391:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828836:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbfc39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828846:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbfc39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.828853:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbfc39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857316.828920:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787857316.828924:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857316.829019:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbfc39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829030:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829037:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829044:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829050:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857316.829055:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829062:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829073:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:2.0:1787857316.829080:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857316.829085:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829092:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829104:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829110:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829117:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829122:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857316.829124:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829130:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829136:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fd949362c00) 00010000:00010000:2.0:1787857316.829138:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857316.829141:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829147:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829177:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ccb expref: 8 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829199:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84c00/0xf326646fe3bbfc39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ccb expref: 7 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.829207:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd949362000) 00010000:00010000:2.0:1787857316.829210:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857316.829212:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84c00, rc 0) 00000100:00100000:2.0:1787857316.830075:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+7:14419:x1874703863102336:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 1877us (5141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857316.830086:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1787857316.849919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857316.851584:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102592 00000100:00100000:1.0:1787857316.851598:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102592 00000100:00100000:1.0:1787857316.851686:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:1.0:1787857316.851756:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:14419:x1874703863102592:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857316.851779:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857316.853592:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfc40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cd2 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853714:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853740:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853754:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853775:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853782:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.853789:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856223:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbfc55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856245:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbfc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856257:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbfc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857316.856446:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787857316.856753:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856763:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856771:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856783:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857316.856788:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856796:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856810:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fd949362000) 00010000:00010000:1.0:1787857316.856814:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.856818:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856824:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856838:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856844:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856850:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856855:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857316.856858:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856864:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856883:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fd963a5f900) 00010000:00010000:1.0:1787857316.856885:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.856889:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.856894:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.857884:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfc40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cd2 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.857904:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978600/0xf326646fe3bbfc55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cd2 expref: 9 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.857912:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:1.0:1787857316.857915:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.857917:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978600, rc 0) 00000100:00100000:1.0:1787857316.858010:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+9:14419:x1874703863102592:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 6314us (8098us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787857316.858019:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857316.863154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857316.864747:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102720 00000100:00100000:2.0:1787857316.864761:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102720 00000100:00100000:2.0:1787857316.864826:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:2.0:1787857316.864837:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+9:14419:x1874703863102720:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787857316.864946:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+9:14419:x1874703863102720:12345-192.168.204.29@tcp:59:lhsmtool_posix.0 Request processed in 110us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857316.864963:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000040:00080000:0.0:1787857316.872299:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787857316.924103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857316.924200:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102848 00000100:00100000:1.0:1787857316.924210:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102848 00000100:00100000:1.0:1787857316.924332:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:1.0:1787857316.924343:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+9:14425:x1874703863102848:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857316.924364:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857316.924385:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfc63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cd9 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924465:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924480:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924492:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924507:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924693:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924702:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924962:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924971:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924977:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.924982:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857316.924986:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925004:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925017:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:1.0:1787857316.925020:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.925024:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925031:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfc6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925044:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925050:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925056:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925061:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857316.925064:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925070:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925077:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857316.925079:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.925082:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925097:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfc71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925133:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfc63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cd9 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925144:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:1.0:1787857316.925146:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857316.925150:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfc63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cd9 expref: 10 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857316.925159:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979e00, rc 0) 00000100:00100000:1.0:1787857316.925233:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+9:14425:x1874703863102848:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 891us (1140us total) trans 0 rc 301/301 00000100:00100000:1.0:1787857316.925240:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1787857316.931113:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857316.931227:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863102976 00000100:00100000:2.0:1787857316.931237:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863102976 00000100:00100000:2.0:1787857316.931291:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1787857316.931302:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3457722-5072-4545-bc79-4670e7583e8a+9:14425:x1874703863102976:12345-192.168.204.29@tcp:700:lfs.0 00000100:00100000:2.0:1787857316.931406:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d3457722-5072-4545-bc79-4670e7583e8a+9:14425:x1874703863102976:12345-192.168.204.29@tcp:700:lfs.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857316.931413:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:0.0:1787857316.938100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857316.938241:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863103232 00000100:00100000:3.0:1787857316.938251:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863103232 00000100:00100000:3.0:1787857316.938475:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 19 00000100:00100000:3.0:1787857316.938485:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+9:14425:x1874703863103232:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:3.0:1787857316.938543:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857316.938569:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882c54 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857316.938590:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:3.0:1787857316.938595:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857316.939070:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857316.939086:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 5 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857316.939095:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857316.939141:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 5 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857316.939153:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 5 pid: 14315 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857316.939168:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885112832:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857316.939286:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddcec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787857316.944222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857316.944306:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863103360 00000100:00100000:0.0:1787857316.944316:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863103360 00010000:00010000:0.0:1787857316.944389:0:14301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 6 pid: 14315 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857316.944435:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:0.0:1787857316.944446:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6427da80-861e-4a71-8198-a1d68c83b701+6:2352:x1874703863103360:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787857316.944463:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857316.944470:0:14301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 6 pid: 14315 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857316.944484:0:14301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 6 pid: 14315 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857316.944510:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:0.0:1787857316.944515:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857316.944526:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857316.944534:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857316.944554:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857316.944607:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6427da80-861e-4a71-8198-a1d68c83b701+6:2352:x1874703863103360:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 163us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857316.944615:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00080000:1.0:1787857316.944810:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787857316.946061:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfbde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cb6 expref: 5 pid: 14315 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857316.946084:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885112832:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857316.946108:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.946269:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.946336:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.946364:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.946376:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.946387:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857316.948814:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787857316.948831:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948841:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948849:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948855:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857316.948859:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948866:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948882:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd953447c00) 00010000:00010000:2.0:1787857316.948885:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857316.948897:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.948904:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737600/0xf326646fe3bbfc78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787857316.950415:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e629bb95 reply state 00000000e585b60d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857316.950435:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857316.950628:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+10:14425:x1874703863103232:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 12139us (12577us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787857316.950638:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 19 00010000:00010000:2.0:1787857316.956767:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956787:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956795:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956801:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857316.956806:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956814:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956833:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fd949362c00) 00010000:00010000:2.0:1787857316.956836:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857316.956840:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857316.956853:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc7f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857317.030505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.030645:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863103488 00000100:00100000:2.0:1787857317.030702:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863103488 00000100:00100000:2.0:1787857317.030772:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:2.0:1787857317.030782:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+9:14433:x1874703863103488:12345-192.168.204.29@tcp:101:lctl.0 00010000:00010000:2.0:1787857317.030808:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.030832:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ce0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.030898:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.030914:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.030927:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857317.031005:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787857317.031009:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857317.031053:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.031079:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ce0 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.031097:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85c00/0xf326646fe3bbfc8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ce0 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.031123:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:2.0:1787857317.031127:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857317.031130:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85c00, rc 0) 00000100:00100000:2.0:1787857317.031191:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+10:14433:x1874703863103488:12345-192.168.204.29@tcp:101:lctl.0 Request processed in 411us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.031198:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 20 00000100:00100000:1.0:1787857317.058627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.058817:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863103616 00000100:00100000:2.0:1787857317.058827:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863103616 00000100:00100000:2.0:1787857317.058882:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:2.0:1787857317.058892:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+5:14434:x1874703863103616:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857317.058913:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.058933:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882ce7 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059012:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059026:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059039:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857317.059101:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787857317.059105:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857317.059128:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059175:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ce7 expref: 7 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059192:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84600/0xf326646fe3bbfc9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882ce7 expref: 6 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.059200:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:2.0:1787857317.059203:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787857317.059207:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84600, rc 0) 00000100:00100000:2.0:1787857317.059279:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+6:14434:x1874703863103616:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 388us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.059285:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 21 00000100:00100000:0.0:1787857317.066054:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.066162:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863103744 00000100:00100000:1.0:1787857317.066173:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863103744 00000100:00100000:1.0:1787857317.066288:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:1.0:1787857317.066299:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+6:14434:x1874703863103744:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857317.066328:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857317.066351:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfca2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cee expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066436:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066479:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066492:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066507:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066524:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066531:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066639:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066647:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066654:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857317.066712:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787857317.066716:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857317.066736:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066748:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066764:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066770:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066776:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857317.066780:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066788:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066799:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:1.0:1787857317.066802:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857317.066807:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066813:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066826:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066832:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066838:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066843:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f978c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857317.066851:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066858:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066865:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857317.066868:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857317.066871:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066877:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066908:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfca2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cee expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066922:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cee expref: 7 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.066929:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:1.0:1787857317.066931:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857317.066934:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979c00, rc 0) 00000100:00100000:1.0:1787857317.067017:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+7:14434:x1874703863103744:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 719us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.067024:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 22 00000100:00100000:3.0:1787857317.072788:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.073068:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863104000 00000100:00100000:0.0:1787857317.073095:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863104000 00000100:00100000:0.0:1787857317.073201:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1787857317.073211:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6427da80-861e-4a71-8198-a1d68c83b701+7:14434:x1874703863104000:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:0.0:1787857317.073232:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857317.073254:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2e00/0xf326646fe3bbfcbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cf5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857317.073399:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787857317.073529:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2e00/0xf326646fe3bbfcbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cf5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.073556:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:0.0:1787857317.073559:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857317.073564:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2e00/0xf326646fe3bbfcbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cf5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.073578:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2e00, rc 0) 00000100:00100000:0.0:1787857317.073642:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6427da80-861e-4a71-8198-a1d68c83b701+8:14434:x1874703863104000:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 433us (865us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787857317.073653:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 23 00000100:00100000:0.0:1787857317.078946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.079175:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863104256 00000100:00100000:1.0:1787857317.079187:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863104256 00000100:00100000:1.0:1787857317.079248:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 24 00000100:00100000:1.0:1787857317.079442:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+8:14434:x1874703863104256:12345-192.168.204.29@tcp:36:lfs.0 00010000:00010000:1.0:1787857317.079803:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857317.079835:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfcb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cee expref: 8 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.079855:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:1.0:1787857317.079868:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787857317.079892:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.079906:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.079916:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787857317.080872:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000495fd7cf reply state 000000006fcfa0cf transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857317.080885:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787857317.080900:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787857317.081073:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+9:14434:x1874703863104256:12345-192.168.204.29@tcp:36:lfs.0 Request processed in 1814us (2137us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787857317.081082:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 24 00010000:00010000:1.0:1787857317.083898:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.083917:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.083925:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.083945:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979e00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857317.083961:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.083970:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.083988:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857317.083991:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787857317.083996:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.084002:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfccc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857317.085149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.085240:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863104512 00000100:00100000:3.0:1787857317.085250:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863104512 00000100:00100000:3.0:1787857317.085455:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857317.085466:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6427da80-861e-4a71-8198-a1d68c83b701+8:14434:x1874703863104512:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1787857317.085936:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6427da80-861e-4a71-8198-a1d68c83b701+9:14434:x1874703863104512:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 471us (794us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787857317.085944:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857317.090948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.091192:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863104768 00000100:00100000:0.0:1787857317.091203:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863104768 00000100:00100000:3.0:1787857317.091352:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:3.0:1787857317.091380:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+9:14434:x1874703863104768:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:3.0:1787857317.091404:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857317.091423:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfcd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882cfc expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091498:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091513:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091525:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091539:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091546:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.091553:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857317.091884:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787857317.092001:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092010:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092017:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092035:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.092039:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092047:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092060:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:3.0:1787857317.092064:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.092069:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092075:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfcda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092087:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092093:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092099:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092104:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.092106:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092112:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092131:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fd982155800) 00010000:00010000:3.0:1787857317.092134:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.092136:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092142:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfce1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092182:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfcd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cfc expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092192:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:3.0:1787857317.092194:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787857317.092198:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfcd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882cfc expref: 11 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.092206:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843737400, rc 0) 00000100:00100000:3.0:1787857317.092426:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6427da80-861e-4a71-8198-a1d68c83b701+10:14434:x1874703863104768:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 1049us (1486us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787857317.092435:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 25 00000100:00100000:0.0:1787857317.096800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.096876:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863104896 00000100:00100000:1.0:1787857317.096885:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863104896 00000100:00100000:1.0:1787857317.096940:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1787857317.096961:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+10:14434:x1874703863104896:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857317.096989:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857317.097011:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d03 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097105:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097118:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097129:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857317.097196:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787857317.097200:0:14316:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787857317.097220:0:14316:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097247:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfcef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 12 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097277:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.097286:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:1.0:1787857317.097289:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787857317.097292:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979400, rc 0) 00000100:00100000:1.0:1787857317.097368:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6427da80-861e-4a71-8198-a1d68c83b701+11:14434:x1874703863104896:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 419us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.097376:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 26 00000100:00100000:1.0:1787857317.101515:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.101612:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105024 00000100:00100000:2.0:1787857317.101623:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105024 00000100:00100000:2.0:1787857317.101711:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:2.0:1787857317.101723:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6427da80-861e-4a71-8198-a1d68c83b701+11:14434:x1874703863105024:12345-192.168.204.29@tcp:37:lfs.0 00000100:00100000:2.0:1787857317.106534:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6427da80-861e-4a71-8198-a1d68c83b701+11:14434:x1874703863105024:12345-192.168.204.29@tcp:37:lfs.0 Request processed in 4803us (5018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.106548:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:0.0:1787857317.111010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.111094:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105280 00000100:00100000:3.0:1787857317.111105:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105280 00000100:00100000:3.0:1787857317.111166:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:3.0:1787857317.111177:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd946304050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6427da80-861e-4a71-8198-a1d68c83b701+11:14434:x1874703863105280:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:3.0:1787857317.111458:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd946304050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6427da80-861e-4a71-8198-a1d68c83b701+12:14434:x1874703863105280:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 282us (457us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787857317.111467:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:0.0:1787857317.166653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.168014:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105408 00000100:00100000:2.0:1787857317.168027:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105408 00000100:00100000:2.0:1787857317.168101:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:2.0:1787857317.168112:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+10:14440:x1874703863105408:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:2.0:1787857317.168135:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.168160:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfcfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d0a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.168249:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.168990:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169004:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169025:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169032:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169038:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169151:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbfd12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169160:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbfd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169167:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbfd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857317.169198:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787857317.169201:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787857317.169242:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbfd12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169427:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169433:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169440:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169446:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857317.169450:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169457:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169470:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:2.0:1787857317.169473:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857317.169477:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169483:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169496:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169768:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169774:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169786:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa85800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857317.169790:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.169796:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.170144:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fd949362700) 00010000:00010000:2.0:1787857317.170148:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857317.170151:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.170158:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfd0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.170199:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfcfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d0a expref: 12 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.170212:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84400/0xf326646fe3bbfd12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d0a expref: 11 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.170219:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:2.0:1787857317.170221:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787857317.170224:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84400, rc 0) 00000100:00100000:2.0:1787857317.170496:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+11:14440:x1874703863105408:12345-192.168.204.29@tcp:101:bash.0 Request processed in 2384us (3851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.170505:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 27 00000100:00100000:0.0:1787857317.174247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.174447:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105664 00000100:00100000:3.0:1787857317.174457:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105664 00000100:00100000:3.0:1787857317.174528:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 28 00000100:00100000:3.0:1787857317.174539:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+11:14440:x1874703863105664:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:3.0:1787857317.174559:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787857317.174586:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfd19 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d11 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.174837:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.174853:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.174862:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.174897:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 11 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.174910:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 11 pid: 14316 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.174924:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885112960:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857317.175116:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddcee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787857317.184373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.184477:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105792 00000100:00100000:1.0:1787857317.184487:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105792 00010000:00010000:1.0:1787857317.184530:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 12 pid: 14316 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857317.184573:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:1.0:1787857317.184584:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6427da80-861e-4a71-8198-a1d68c83b701+12:2352:x1874703863105792:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857317.184599:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857317.184606:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 12 pid: 14316 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.184635:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 12 pid: 14316 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.184691:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:1.0:1787857317.184697:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.184708:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.184716:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.184736:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857317.184788:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6427da80-861e-4a71-8198-a1d68c83b701+12:2352:x1874703863105792:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 205us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.184796:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00010000:00010000:3.0:1787857317.189488:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfcf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d03 expref: 11 pid: 14316 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.189583:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97ba3f840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885112960:192.168.204.29@tcp:104: 00010000:00010000:3.0:1787857317.189635:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.189647:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.189654:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.189849:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.189864:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.189875:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190853:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190866:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190875:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857317.190887:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787857317.190919:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190926:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190943:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190960:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.190964:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190972:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190985:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:3.0:1787857317.190988:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.190992:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.190998:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfd20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787857317.191010:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000379e9ee4 reply state 000000002a197fee transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.191019:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787857317.191110:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfd19 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.191125:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 13 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.191132:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:3.0:1787857317.191141:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787857317.191144:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd843737a00, rc 0) 00000100:00100000:3.0:1787857317.191229:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+14:14440:x1874703863105664:12345-192.168.204.29@tcp:101:bash.0 Request processed in 16691us (16993us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787857317.191238:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 28 00010000:00010000:2.0:1787857317.194118:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194147:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194156:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194162:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737c00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857317.194167:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194174:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194190:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fd982155800) 00010000:00010000:2.0:1787857317.194194:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857317.194198:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.194205:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737c00/0xf326646fe3bbfd27 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.212515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.212627:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863105920 00000100:00100000:0.0:1787857317.212638:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863105920 00000100:00100000:0.0:1787857317.212735:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:0.0:1787857317.212746:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+13:14440:x1874703863105920:12345-192.168.204.29@tcp:101:bash.0 00010000:00010000:0.0:1787857317.212770:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857317.212793:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3e00/0xf326646fe3bbfd3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d18 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.212869:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.212885:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.212897:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857317.212941:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787857317.212957:0:14315:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857317.212982:0:14315:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.212994:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.213019:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3e00/0xf326646fe3bbfd3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.213050:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.213079:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:0.0:1787857317.213082:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787857317.213086:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2000, rc 0) 00000100:00100000:0.0:1787857317.213166:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+14:14440:x1874703863105920:12345-192.168.204.29@tcp:101:bash.0 Request processed in 422us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.213174:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 29 00000100:00100000:3.0:1787857317.217744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.217791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.217836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.217862:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106176 00000100:00100000:3.0:1787857317.217872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.217874:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106176 00000100:00100000:3.0:1787857317.217913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.217930:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106432 00000100:00100000:0.0:1787857317.217934:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106432 00000100:00100000:0.0:1787857317.217959:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106304 00000100:00100000:0.0:1787857317.217962:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106304 00000100:00100000:0.0:1787857317.217975:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106560 00000100:00100000:0.0:1787857317.217977:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106560 00000100:00100000:0.0:1787857317.217994:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857317.218003:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2352:x1874703863106176:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857317.218102:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2352:x1874703863106176:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.218110:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857317.218129:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1787857317.218136:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97ba3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2352:x1874703863106432:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857317.218159:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97ba3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2352:x1874703863106432:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.218165:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1787857317.218175:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1787857317.218194:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2352:x1874703863106304:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857317.218215:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2352:x1874703863106304:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 21us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.218220:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1787857317.218232:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:0.0:1787857317.218238:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2352:x1874703863106560:12345-192.168.204.29@tcp:400:kworker.0 00000100:00100000:0.0:1787857317.218256:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6427da80-861e-4a71-8198-a1d68c83b701+5:2352:x1874703863106560:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 18us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.218262:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1787857317.218330:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106048 00000100:00100000:1.0:1787857317.218335:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106048 00000100:00100000:1.0:1787857317.218371:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:1.0:1787857317.218379:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2352:x1874703863106048:12345-192.168.204.29@tcp:400:kworker.0 00000100:00080000:3.0:1787857317.218384:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787857317.218391:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787857317.218412:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77fe3580-dc54-49f7-8e5a-5b39c991850c+13:2352:x1874703863106048:12345-192.168.204.29@tcp:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.218420:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 121 00000100:00100000:3.0:1787857317.227783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.228019:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863106816 00000100:00100000:2.0:1787857317.228041:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863106816 00000100:00100000:2.0:1787857317.228113:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:2.0:1787857317.228125:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+14:14440:x1874703863106816:12345-192.168.204.29@tcp:35:bash.0 00000100:00100000:2.0:1787857317.228529:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+15:14440:x1874703863106816:12345-192.168.204.29@tcp:35:bash.0 Request processed in 405us (755us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787857317.228538:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1787857317.323754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.324003:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863107072 00000100:00100000:2.0:1787857317.324014:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863107072 00000100:00100000:2.0:1787857317.325123:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:2.0:1787857317.325135:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+15:14450:x1874703863107072:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:2.0:1787857317.325167:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.325188:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d1f expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857317.325330:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787857317.325451:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d1f expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.325465:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fd949362c00) 00010000:00010000:2.0:1787857317.325468:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857317.325472:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d1f expref: 17 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.325487:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84800, rc 0) 00000100:00100000:2.0:1787857317.325561:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+16:14450:x1874703863107072:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 429us (1817us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787857317.325569:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 30 00000100:00100000:0.0:1787857317.334583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.334695:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863107328 00000100:00100000:2.0:1787857317.334705:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863107328 00000100:00100000:2.0:1787857317.334766:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:2.0:1787857317.334776:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+16:14450:x1874703863107328:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857317.335554:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+17:14450:x1874703863107328:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 776us (980us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787857317.335581:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1787857317.365554:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.365812:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863107584 00000100:00100000:1.0:1787857317.365821:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863107584 00000100:00100000:1.0:1787857317.365888:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:1.0:1787857317.365911:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+17:14453:x1874703863107584:12345-192.168.204.29@tcp:101:lfs.0 00010000:00010000:1.0:1787857317.365938:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857317.366087:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfd58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d26 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.366212:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbfd5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.366227:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbfd5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.366240:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbfd5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787857317.366251:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787857317.366483:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978c00/0xf326646fe3bbfd58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d26 expref: 20 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.366501:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbfd5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d26 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.366509:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:1.0:1787857317.367632:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857317.367638:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f978a00, rc 0) 00000100:00100000:0.0:1787857317.369533:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+19:14453:x1874703863107584:12345-192.168.204.29@tcp:101:lfs.0 Request processed in 3614us (3979us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787857317.369545:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 31 00000100:00100000:0.0:1787857317.372649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.374078:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863107712 00000100:00100000:2.0:1787857317.374089:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863107712 00000100:00100000:2.0:1787857317.374264:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:2.0:1787857317.374276:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+19:14453:x1874703863107712:12345-192.168.204.29@tcp:54:lfs.0 00010000:00010000:2.0:1787857317.374421:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374438:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374450:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374480:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374486:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374492:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374498:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97fa84800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857317.374502:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374509:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374520:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.374537:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787857317.374542:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.374548:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.375154:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+19:14453:x1874703863107712:12345-192.168.204.29@tcp:54:lfs.0 Request processed in 877us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.375164:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 32 00000100:00100000:3.0:1787857317.375233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.375395:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863107840 00000100:00100000:2.0:1787857317.375401:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863107840 00000100:00100000:2.0:1787857317.375478:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:2.0:1787857317.375488:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+19:2352:x1874703863107840:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857317.375501:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857317.375532:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f978a00/0xf326646fe3bbfd5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d26 expref: 19 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.375546:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.375550:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857317.375589:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+18:2352:x1874703863107840:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.375595:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1787857317.378521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.379246:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863108096 00000100:00100000:2.0:1787857317.379258:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863108096 00000100:00100000:2.0:1787857317.379487:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:2.0:1787857317.379497:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+18:14453:x1874703863108096:12345-192.168.204.29@tcp:35:lfs.0 00000100:00100000:2.0:1787857317.379932:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+19:14453:x1874703863108096:12345-192.168.204.29@tcp:35:lfs.0 Request processed in 435us (1422us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787857317.379971:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00010000:00010000:1.0:1787857317.578395:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787857317.675112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.675217:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863108352 00000100:00100000:2.0:1787857317.675227:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863108352 00000100:00100000:2.0:1787857317.675299:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:2.0:1787857317.675310:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+19:14484:x1874703863108352:12345-192.168.204.29@tcp:101:cat.0 00010000:00010000:2.0:1787857317.675333:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.675353:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d2d expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.675462:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.675477:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.675491:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787857317.675653:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787857317.675836:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d2d expref: 22 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.675854:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d2d expref: 21 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.675862:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.675865:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787857317.675868:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84e00, rc 0) 00000100:00100000:2.0:1787857317.675963:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+21:14484:x1874703863108352:12345-192.168.204.29@tcp:101:cat.0 Request processed in 655us (868us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787857317.675971:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 33 00000100:00100000:0.0:1787857317.680829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.680885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.681130:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863108480 00000100:00100000:1.0:1787857317.681141:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863108480 00000100:00100000:1.0:1787857317.681202:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1787857317.681213:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3457722-5072-4545-bc79-4670e7583e8a+21:2355:x1874703863108480:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857317.681266:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857317.681293:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d2d expref: 21 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.681315:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:1.0:1787857317.681320:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857317.681378:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d3457722-5072-4545-bc79-4670e7583e8a+20:2355:x1874703863108480:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 167us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.681386:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:3.0:1787857317.682145:0:14318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863108736 00000100:00100000:3.0:1787857317.682153:0:14318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863108736 00000100:00100000:3.0:1787857317.682194:0:14318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:3.0:1787857317.682203:0:14318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3457722-5072-4545-bc79-4670e7583e8a+20:14484:x1874703863108736:12345-192.168.204.29@tcp:35:cat.0 00000100:00100000:2.0:1787857317.683072:0:14318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d3457722-5072-4545-bc79-4670e7583e8a+21:14484:x1874703863108736:12345-192.168.204.29@tcp:35:cat.0 Request processed in 867us (2183us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787857317.683081:0:14318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 8 00000100:00100000:0.0:1787857317.755166:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.761305:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863108992 00000100:00100000:2.0:1787857317.761319:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863108992 00000100:00100000:2.0:1787857317.761543:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:2.0:1787857317.761553:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+21:14490:x1874703863108992:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1787857317.761578:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.761600:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d34 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.761982:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.761999:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.762008:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.762016:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.762115:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.762150:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 22 pid: 14315 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.762164:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb4b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113088:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857317.762344:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.762354:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.762364:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97bb49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113216:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857317.762389:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd945cd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787857317.767431:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb4b840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113088:192.168.204.29@tcp:104: 00000100:00100000:2.0:1787857317.767449:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97bb49e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113216:192.168.204.29@tcp:104: 00010000:00010000:2.0:1787857317.767497:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857317.769995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.770125:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863109120 00000100:00100000:1.0:1787857317.770137:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863109120 00010000:00010000:1.0:1787857317.770181:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 23 pid: 14315 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857317.771898:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:1.0:1787857317.771919:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+23:2353:x1874703863109120:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857317.771950:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857317.771963:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 23 pid: 14315 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.771979:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 23 pid: 14315 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.772004:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfd43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d18 expref: 23 pid: 14315 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.772020:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:1.0:1787857317.772040:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.772050:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.772057:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857317.772134:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+22:2353:x1874703863109120:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 224us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.772143:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:3.0:1787857317.773921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.775200:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863109248 00000100:00100000:2.0:1787857317.775212:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863109248 00010000:00010000:2.0:1787857317.775271:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.775313:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:2.0:1787857317.775331:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+22:2353:x1874703863109248:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857317.775361:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857317.775369:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775383:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775408:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfd2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d11 expref: 22 pid: 14314 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775424:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.775429:0:14299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775439:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775446:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.775610:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857317.775681:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+21:2353:x1874703863109248:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 359us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.775689:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00010000:00010000:3.0:1787857317.778650:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.778952:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857317.778979:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787857317.779929:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfd89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d34 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.779966:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84e00/0xf326646fe3bbfd90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d34 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.779977:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:3.0:1787857317.779981:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787857317.779984:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84e00, rc 0) 00000100:00100000:3.0:1787857317.780186:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+21:14490:x1874703863108992:12345-192.168.204.29@tcp:101:dd.0 Request processed in 18632us (25027us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787857317.780195:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 34 00000100:00100000:1.0:1787857317.791147:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.791422:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863109504 00000100:00100000:0.0:1787857317.791432:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863109504 00000100:00100000:0.0:1787857317.791985:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 35 00000100:00100000:0.0:1787857317.791998:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+21:14490:x1874703863109504:12345-192.168.204.29@tcp:36:dd.0 00010000:00010000:0.0:1787857317.792372:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.792440:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.792463:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857317.792530:0:14315:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787857317.792560:0:14315:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002d03c4e reply state 0000000078abdbdc transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857317.792568:0:14315:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857317.792704:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+24:14490:x1874703863109504:12345-192.168.204.29@tcp:36:dd.0 Request processed in 708us (1566us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787857317.792721:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 35 00000020:00080000:0.0:1787857317.792726:0:14315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787857317.796877:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.797423:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863109632 00000100:00100000:2.0:1787857317.797434:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863109632 00000100:00100000:2.0:1787857317.797518:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 36 00000100:00100000:2.0:1787857317.797529:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+24:14490:x1874703863109632:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1787857317.797576:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.797614:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfda5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d3b expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.797720:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfda5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d3b expref: 25 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.797736:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfda5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d3b expref: 25 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.797758:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.797761:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857317.797766:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84800, rc 0) 00000100:00100000:2.0:1787857317.797835:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+25:14490:x1874703863109632:12345-192.168.204.29@tcp:101:dd.0 Request processed in 308us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.797842:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 36 00010000:00010000:1.0:1787857317.798276:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798286:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798293:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798299:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c2400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857317.798319:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798327:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798340:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:1.0:1787857317.798343:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857317.798346:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.798366:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2400/0xf326646fe3bbfd9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857317.854387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.854601:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863109888 00000100:00100000:0.0:1787857317.854617:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863109888 00000100:00100000:0.0:1787857317.854838:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:0.0:1787857317.854851:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+24:14490:x1874703863109888:12345-192.168.204.29@tcp:103:dd.0 00010000:00010000:0.0:1787857317.854872:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857317.854904:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84800/0xf326646fe3bbfda5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d3b expref: 24 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.854926:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:0.0:1787857317.854946:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787857317.855010:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+23:14490:x1874703863109888:12345-192.168.204.29@tcp:103:dd.0 Request processed in 162us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.855018:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857317.865696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.865896:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110016 00000100:00100000:0.0:1787857317.865907:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110016 00000100:00100000:0.0:1787857317.866045:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:0.0:1787857317.866056:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+23:14490:x1874703863110016:12345-192.168.204.29@tcp:58:dd.0 00010000:00010000:0.0:1787857317.866153:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.866184:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.866196:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787857317.867035:0:14315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787857317.867201:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787857317.867273:0:14315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787857317.867388:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd981f052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+23:14490:x1874703863110016:12345-192.168.204.29@tcp:58:dd.0 Request processed in 1331us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.867398:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 37 00000100:00100000:3.0:1787857317.874161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.874451:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110144 00000100:00100000:2.0:1787857317.874463:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110144 00000100:00100000:2.0:1787857317.874524:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 38 00000100:00100000:2.0:1787857317.874534:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+23:14490:x1874703863110144:12345-192.168.204.29@tcp:101:dd.0 00010000:00010000:2.0:1787857317.874555:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.874580:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d42 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874639:0:14316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874693:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874711:0:14316:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874724:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874738:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857317.874741:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857317.874744:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 24 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.874752:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa85800, rc 0) 00000100:00100000:2.0:1787857317.874816:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+24:14490:x1874703863110144:12345-192.168.204.29@tcp:101:dd.0 Request processed in 283us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.874823:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 38 00000040:00080000:0.0:1787857317.896691:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787857317.896701:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857317.896924:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787857317.896931:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787857317.897495:0:14349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd842c012c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14349:1874703885113344:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787857317.897607:0:14349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787857317.904621:0:14349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd842c012c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14349:1874703885113344:192.168.204.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787857317.905912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.906035:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110272 00000100:00100000:3.0:1787857317.906044:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110272 00000100:00100000:3.0:1787857317.906103:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1787857317.906113:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110272:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787857317.906212:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110272:12345-192.168.204.29@tcp:900:lhsmtool_posix.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857317.906220:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:3.0:1787857317.909971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.913213:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110400 00000100:00100000:0.0:1787857317.913231:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110400 00000100:00100000:0.0:1787857317.913449:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1787857317.913476:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110400:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787857317.913510:0:14315:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787857317.913718:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110400:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 243us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.913725:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 39 00000100:00100000:0.0:1787857317.919142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.925047:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110528 00000100:00100000:3.0:1787857317.925062:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110528 00000100:00100000:3.0:1787857317.925134:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:3.0:1787857317.925146:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110528:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787857317.925231:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925261:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925273:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925289:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925296:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925313:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925338:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925346:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925353:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787857317.925392:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787857317.925396:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787857317.925412:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925423:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925436:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925443:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925449:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736200 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.925453:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925461:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925475:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:3.0:1787857317.925478:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.925483:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925489:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736200/0xf326646fe3bbfdba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925503:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925509:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925871:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925877:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.925886:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925893:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925901:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fd982155600) 00010000:00010000:3.0:1787857317.925905:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.925908:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925913:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfdc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925928:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925947:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925953:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925958:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.925961:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925967:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925973:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:3.0:1787857317.925975:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.925985:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.925991:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfdc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.926128:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110528:12345-192.168.204.29@tcp:34:lhsmtool_posix.0 Request processed in 982us (6992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857317.926137:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 40 00000100:00100000:1.0:1787857317.932065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.932172:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110784 00000100:00100000:0.0:1787857317.932182:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110784 00000100:00100000:0.0:1787857317.932242:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:0.0:1787857317.932263:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+24:14491:x1874703863110784:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857317.932282:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857317.932311:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfdcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d49 expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932415:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932430:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932442:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857317.932453:0:14316:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787857317.932554:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932564:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932589:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932595:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c2a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:0.0:1787857317.932599:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932606:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932621:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:0.0:1787857317.932624:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787857317.932629:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932634:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfdd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932720:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfdcf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d49 expref: 26 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932732:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fd963a5f000) 00010000:00010000:0.0:1787857317.932734:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787857317.932738:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2000/0xf326646fe3bbfdcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d49 expref: 26 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.932748:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2000, rc 0) 00000100:00100000:0.0:1787857317.932811:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+25:14491:x1874703863110784:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 561us (756us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787857317.932829:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 41 00000100:00100000:1.0:1787857317.938269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.938822:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863110912 00000100:00100000:3.0:1787857317.938832:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863110912 00000100:00100000:3.0:1787857317.938896:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:3.0:1787857317.938906:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+25:14491:x1874703863110912:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787857317.938978:0:14314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787857317.939196:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+25:14491:x1874703863110912:12345-192.168.204.29@tcp:53:lhsmtool_posix.0 Request processed in 292us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857317.939204:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 42 00000100:00100000:0.0:1787857317.943743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.944259:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863111168 00000100:00100000:1.0:1787857317.944268:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863111168 00000100:00100000:1.0:1787857317.944334:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:1.0:1787857317.944344:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+25:14491:x1874703863111168:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857317.944367:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857317.944388:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfde4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d50 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787857317.948210:0:14315:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1787857317.948224:0:14315:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787857317.948436:0:14315:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787857317.949229:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfdeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.949379:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.949392:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.949469:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfde4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d50 expref: 28 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.949506:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfdeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d50 expref: 27 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.949582:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857317.949585:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787857317.949589:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979e00, rc 0) 00000100:00100000:1.0:1787857317.949806:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+27:14491:x1874703863111168:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 5462us (6071us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787857317.949814:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 43 00000100:00100000:1.0:1787857317.955032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.955171:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863111424 00000100:00100000:3.0:1787857317.955183:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863111424 00000100:00100000:3.0:1787857317.955256:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:3.0:1787857317.955268:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+27:14491:x1874703863111424:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857317.955328:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787857317.955372:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979e00/0xf326646fe3bbfdeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d50 expref: 27 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955392:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:3.0:1787857317.955404:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787857317.955428:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955455:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955466:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955484:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955491:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955498:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955579:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955586:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955593:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955598:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.955603:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955611:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955620:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fd963a5f200) 00010000:00010000:3.0:1787857317.955628:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.955633:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955640:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfdf9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955651:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.955657:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.956026:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.956031:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857317.956035:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.956041:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.956050:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x48e9de88 (ffff9fd982155600) 00010000:00010000:3.0:1787857317.956053:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787857317.956056:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.956062:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x48e9de88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.956159:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+26:14491:x1874703863111424:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 893us (1139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787857317.956174:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 44 00000100:00100000:2.0:1787857317.961104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.961883:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863111552 00000100:00100000:1.0:1787857317.961973:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863111552 00000100:00100000:1.0:1787857317.962082:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:1.0:1787857317.962094:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+26:14491:x1874703863111552:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787857317.962114:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787857317.962137:0:14315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfe07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d57 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962174:0:14315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfe0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962187:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfe0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962198:0:14315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfe0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962335:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979400/0xf326646fe3bbfe07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d57 expref: 28 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962357:0:14315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97f979c00/0xf326646fe3bbfe0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d57 expref: 27 pid: 14315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857317.962365:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857317.962369:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787857317.962372:0:14315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97f979c00, rc 0) 00000100:00100000:1.0:1787857317.962448:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+27:14491:x1874703863111552:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 357us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.962456:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 45 00000100:00100000:0.0:1787857317.968210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857317.968573:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863111808 00000100:00100000:3.0:1787857317.968586:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863111808 00000100:00100000:3.0:1787857317.968702:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 46 00000100:00100000:3.0:1787857317.968713:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+27:14491:x1874703863111808:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787857317.968809:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.968828:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857317.968840:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787857317.970090:0:14314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787857317.970109:0:14314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 472298448308ns, next at 473298444683ns, rc = 0 00000004:00010000:3.0:1787857317.970217:0:14314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6e8d178 reply state 00000000c94f6707 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857317.970228:0:14314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787857317.972478:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+29:14491:x1874703863111808:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 3753us (4264us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787857317.972493:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 46 00010000:00010000:2.0:1787857317.975350:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975367:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975395:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975401:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857317.975405:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975413:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975431:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:2.0:1787857317.975434:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787857317.975439:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.975445:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737a00/0xf326646fe3bbfe15 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857317.977928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.978570:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863111936 00000100:00100000:2.0:1787857317.978582:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863111936 00000100:00100000:2.0:1787857317.978646:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:2.0:1787857317.978656:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+28:14491:x1874703863111936:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857317.978712:0:14316:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.978735:0:14316:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d5e expref: -99 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.978800:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 29 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.978844:0:14316:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 29 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.978864:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:2.0:1787857317.978867:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787857317.978870:0:14316:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84200, rc 0) 00000100:00100000:2.0:1787857317.979021:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+29:14491:x1874703863111936:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 366us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.979029:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 47 00000100:00100000:3.0:1787857317.982406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.982500:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863112064 00000100:00100000:0.0:1787857317.982511:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863112064 00000100:00100000:0.0:1787857317.982574:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:0.0:1787857317.982584:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+5:2352:x1874703863112064:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787857317.983015:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+6:2352:x1874703863112064:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 430us (617us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787857317.983023:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 12 00000100:00100000:1.0:1787857317.986839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.987069:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863112320 00000100:00100000:2.0:1787857317.987079:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863112320 00000100:00100000:2.0:1787857317.987143:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:2.0:1787857317.987154:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+29:14491:x1874703863112320:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787857317.987484:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+30:14491:x1874703863112320:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 330us (656us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787857317.987492:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 9 00000100:00100000:3.0:1787857317.990256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857317.990401:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863112576 00000100:00100000:1.0:1787857317.990411:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863112576 00000100:00100000:1.0:1787857317.990474:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:1.0:1787857317.990484:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+30:14491:x1874703863112576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787857317.990614:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d3457722-5072-4545-bc79-4670e7583e8a+30:14491:x1874703863112576:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 131us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857317.990623:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 48 00000100:00100000:3.0:1787857317.993135:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857317.993234:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863112704 00000100:00100000:0.0:1787857317.993246:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863112704 00000100:00100000:0.0:1787857317.993382:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:0.0:1787857317.993393:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+30:14491:x1874703863112704:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857317.993413:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857317.993436:0:14314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d65 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.993537:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.993554:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.993948:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787857317.994015:0:14314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787857317.994038:0:14314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.994070:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d65 expref: 32 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.994088:0:14314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d65 expref: 31 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857317.994098:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:0.0:1787857317.994100:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787857317.994104:0:14314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2800, rc 0) 00000100:00100000:0.0:1787857317.994170:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+31:14491:x1874703863112704:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 779us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857317.994178:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 49 00000100:00100000:3.0:1787857317.998081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857317.998186:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863112832 00000100:00100000:2.0:1787857317.998197:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863112832 00000100:00100000:2.0:1787857317.998375:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1787857317.998388:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3457722-5072-4545-bc79-4670e7583e8a+6:2352:x1874703863112832:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787857317.998407:0:14998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787857317.998430:0:14998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d6c expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787857317.998459:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9089a5, blocks: 0x1 00010000:00010000:2.0:1787857317.998498:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1787857317.998503:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857317.998514:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 7 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.998534:0:14998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 7 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857317.998550:0:14998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97fa84800, rc 0) 00000100:00100000:2.0:1787857317.998616:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:2352:x1874703863112832:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 230us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857317.998623:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:3.0:1787857318.000920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857318.001159:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113088 00000100:00100000:2.0:1787857318.001169:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113088 00000100:00100000:2.0:1787857318.001315:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00100000:2.0:1787857318.001330:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+31:14491:x1874703863113088:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787857318.001458:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+31:14491:x1874703863113088:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 134us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857318.001466:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 50 00000100:00080000:3.0:1787857318.001641:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787857318.003901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.004012:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113216 00000100:00100000:0.0:1787857318.004091:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113216 00000100:00100000:0.0:1787857318.004221:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:0.0:1787857318.004231:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+31:14491:x1874703863113216:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787857318.067228:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1787857318.067262:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:2.0:1787857318.067267:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1787857318.067274:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1787857318.067286:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787857318.067328:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787857318.067349:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787857318.067652:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787857318.067695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885113472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787857318.067763:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857318.067838:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885113472 00000100:00100000:1.0:1787857318.067845:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885113472 00000100:00100000:1.0:1787857318.067911:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787857318.067920:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874703885113472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787857318.068105:0:14996:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787857318.068109:0:14996:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787857318.068112:0:14996:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787857318.068114:0:14996:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787857317 -> 1787857317 00002000:00010000:1.0:1787857318.068116:0:14996:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787857318.068156:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874703885113472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (393us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787857318.068164:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787857318.068190:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787857318.068217:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fd97b765a40/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787857318.068223:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874703885113472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787857318.068690:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+14:14491:x1874703863113216:12345-192.168.204.29@tcp:44:lhsmtool_posix.0 Request processed in 64429us (64766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857318.068706:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 51 00000100:00100000:0.0:1787857318.075477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857318.078510:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113344 00000100:00100000:2.0:1787857318.078525:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113344 00000100:00100000:2.0:1787857318.078601:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:2.0:1787857318.078612:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:2353:x1874703863113344:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787857318.078780:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd842c00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d3457722-5072-4545-bc79-4670e7583e8a+7:2353:x1874703863113344:12345-192.168.204.29@tcp:16:lhsmtool_posix.0 Request processed in 170us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857318.078788:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:3.0:1787857318.081332:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.081718:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113600 00000100:00100000:0.0:1787857318.081728:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113600 00000100:00100000:0.0:1787857318.081855:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 52 00000100:00100000:0.0:1787857318.081865:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+14:14491:x1874703863113600:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787857318.081924:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787857318.081963:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2800/0xf326646fe3bbfe2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d65 expref: 14 pid: 14314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.081990:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:0.0:1787857318.081996:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787857318.082025:0:14316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.082038:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.082047:0:14316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787857318.082234:0:14316:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db961726 reply state 000000003feeb151 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.082372:0:14316:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787857318.082530:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d3457722-5072-4545-bc79-4670e7583e8a+15:14491:x1874703863113600:12345-192.168.204.29@tcp:36:lhsmtool_posix.0 Request processed in 664us (1205us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787857318.082538:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 52 00010000:00010000:1.0:1787857318.085908:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.085925:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.085943:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.085949:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c2a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:1.0:1787857318.085954:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.085962:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.085991:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857318.086009:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787857318.086015:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.086021:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2a00/0xf326646fe3bbfe38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.086820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.086945:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113728 00000100:00100000:0.0:1787857318.086955:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113728 00000100:00100000:0.0:1787857318.087015:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:0.0:1787857318.087025:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+7:14491:x1874703863113728:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787857318.087041:0:14997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787857318.087064:0:14997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf3eac3f2aa882d73 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.087094:0:14997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 8 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.087103:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857318.087108:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857318.087113:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.087147:0:14997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 8 pid: 14998 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.087162:0:14997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 8 pid: 14998 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.087176:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14997:1874703885113600:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857318.087260:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857318.091486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857318.091608:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113856 00000100:00100000:1.0:1787857318.091617:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113856 00010000:00010000:1.0:1787857318.091657:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 9 pid: 14998 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.091722:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:1.0:1787857318.091731:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+9:2353:x1874703863113856:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857318.091747:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857318.091770:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 9 pid: 14998 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.091783:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 9 pid: 14998 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.091809:0:14300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.091813:0:14300:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.091821:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.091831:0:14300:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.091892:0:14300:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.091906:0:14300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b766d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14300:1874703885113728:192.168.204.29@tcp:105: 00010000:00010000:0.0:1787857318.092007:0:14997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b64fb1/0xf326646fe3bbfe31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d6c expref: 9 pid: 14998 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.092076:0:14300:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd946020c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787857318.092090:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14997:1874703885113600:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857318.092120:0:14997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.092142:0:14997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fd97c2c2e00, rc 0) 00000100:00100000:0.0:1787857318.092243:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a405a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+8:14491:x1874703863113728:12345-192.168.204.29@tcp:101:lhsmtool_posix.0 Request processed in 5219us (5429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857318.092251:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 16 00000100:00100000:2.0:1787857318.095188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857318.095271:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863113984 00000100:00100000:3.0:1787857318.095279:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863113984 00000100:00100000:3.0:1787857318.095329:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:3.0:1787857318.095338:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3457722-5072-4545-bc79-4670e7583e8a+8:2353:x1874703863113984:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787857318.095537:0:14996:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787857318.095541:0:14996:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787857317 00002000:00010000:3.0:1787857318.095544:0:14996:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787857316 00002000:00010000:3.0:1787857318.095546:0:14996:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787857317 -> 1787857317 00002000:00010000:3.0:1787857318.095548:0:14996:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787857318.095607:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d3457722-5072-4545-bc79-4670e7583e8a+9:2353:x1874703863113984:12345-192.168.204.29@tcp:2:lhsmtool_posix.0 Request processed in 270us (428us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787857318.095616:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 17 00000100:00100000:1.0:1787857318.095885:0:14300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b766d00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14300:1874703885113728:192.168.204.29@tcp:105: 00010000:00010000:1.0:1787857318.095906:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857318.095985:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+8:2353:x1874703863113856:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 4255us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857318.095994:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 13 00000100:00100000:2.0:1787857318.098174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.098413:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863114112 00000100:00100000:0.0:1787857318.098423:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863114112 00000100:00100000:0.0:1787857318.098481:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1787857318.098491:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+8:2352:x1874703863114112:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787857318.098534:0:14997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.098555:0:14997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.098565:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787857318.098570:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787857318.098575:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.098611:0:14997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.098625:0:14997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 8 pid: 14997 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.098690:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14997:1874703885113856:192.168.204.29@tcp:104: 00000100:00100000:0.0:1787857318.098766:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd948bd5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787857318.101603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.101792:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14997:1874703885113856:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857318.101823:0:14997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857318.102389:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863114240 00000100:00100000:2.0:1787857318.102398:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863114240 00010000:00010000:2.0:1787857318.102438:0:14299:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857318.102632:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 14 00000100:00100000:2.0:1787857318.102643:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+9:2352:x1874703863114240:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787857318.102686:0:14299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787857318.102709:0:14299:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.102722:0:14299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.102746:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b0682e/0xf326646fe3bbfe3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d73 expref: 9 pid: 14997 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.102782:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857318.102787:0:14299:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787857318.102792:0:14299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.102802:0:14299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.102827:0:14299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787857318.102889:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a4043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d3457722-5072-4545-bc79-4670e7583e8a+8:2352:x1874703863114240:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 248us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857318.102896:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 14 00010000:00010000:0.0:1787857318.102962:0:14997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.102971:0:14997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.102994:0:14997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103003:0:14997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103010:0:14997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103027:0:14997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c3e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857318.103031:0:14997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103048:0:14997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103061:0:14997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.103070:0:14997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f00a2847/0xf326646fe3bbfe46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.103118:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d3457722-5072-4545-bc79-4670e7583e8a+7:2352:x1874703863114112:12345-192.168.204.29@tcp:1:lhsmtool_posix.0 Request processed in 4629us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857318.103127:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 18 00000100:00100000:0.0:1787857318.105620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857318.105838:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863114496 00000100:00100000:3.0:1787857318.105848:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863114496 00000100:00100000:3.0:1787857318.105906:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 53 00000100:00100000:3.0:1787857318.105917:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+14:14491:x1874703863114496:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787857318.106003:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106032:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106043:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106310:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106331:0:14314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106339:0:14314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106371:0:14314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 15 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.106386:0:14314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 15 pid: 14316 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.106402:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113984:192.168.204.29@tcp:104: 00000100:00100000:3.0:1787857318.106811:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddcecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787857318.112264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857318.112408:0:14300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863114624 00000100:00100000:1.0:1787857318.112418:0:14300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863114624 00010000:00010000:1.0:1787857318.112473:0:14300:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 16 pid: 14316 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.112519:0:14300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 15 00000100:00100000:1.0:1787857318.112530:0:14300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a407c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+16:2353:x1874703863114624:12345-192.168.204.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787857318.112547:0:14300:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787857318.112554:0:14300:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 16 pid: 14316 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.112568:0:14300:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 16 pid: 14316 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.112615:0:14300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857318.112621:0:14300:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.112631:0:14300:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.112638:0:14300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.112655:0:14300:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787857318.112753:0:14300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a407c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d3457722-5072-4545-bc79-4670e7583e8a+16:2353:x1874703863114624:12345-192.168.204.29@tcp:103:ldlm_bl.0 Request processed in 224us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857318.112761:0:14300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 15 00010000:00010000:0.0:1787857318.114843:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa84200/0xf326646fe3bbfe1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d5e expref: 15 pid: 14316 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.114870:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885113984:192.168.204.29@tcp:104: 00010000:00010000:0.0:1787857318.114897:0:14314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.114910:0:14314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.114917:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857318.115403:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787857318.116011:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787857318.116363:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787857318.116551:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874703885114112:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787857318.116632:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857318.116910:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769ceb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787857318.117003:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114112 00000100:00100000:1.0:1787857318.117010:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114112 00000100:00100000:1.0:1787857318.117216:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787857318.117226:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14314:x1874703885114112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787857318.117552:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14314:x1874703885114112:12345-0@lo:1000:mdt00_000.0 Request processed in 327us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857318.117559:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787857318.117792:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874703885114112:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787857318.119210:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787857318.119314:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874703885114240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787857318.119372:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857318.119407:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd9769cee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857318.119861:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114240 00000100:00100000:2.0:1787857318.119869:0:14320:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114240 00000100:00100000:2.0:1787857318.119916:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787857318.119924:0:14320:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14314:x1874703885114240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787857318.120117:0:14320:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14314:x1874703885114240:12345-0@lo:1000:mdt00_000.0 Request processed in 193us (744us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787857318.120123:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787857318.120431:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14314:1874703885114240:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787857318.120476:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120486:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120492:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120497:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736a00 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857318.120501:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120519:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120534:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:3.0:1787857318.120537:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857318.120541:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120547:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843736a00/0xf326646fe3bbfe54 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120575:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120581:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120586:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120590:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c3600 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:3.0:1787857318.120593:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120598:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120604:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:3.0:1787857318.120606:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787857318.120612:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120632:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120651:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.120731:0:14314:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97fa85800/0xf326646fe3bbfdb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.29@tcp remote: 0xf3eac3f2aa882d42 expref: 18 pid: 14316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.120743:0:14314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885114368:192.168.204.29@tcp:105: 00000100:00100000:3.0:1787857318.120805:0:14314:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fd96ddceb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787857318.124497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.124656:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863114752 00000100:00100000:0.0:1787857318.124700:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863114752 00000100:00100000:0.0:1787857318.124755:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:0.0:1787857318.124765:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd946304850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+19:14490:x1874703863114752:12345-192.168.204.29@tcp:49:dd.0 00000100:00100000:0.0:1787857318.124884:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd946304850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+19:14490:x1874703863114752:12345-192.168.204.29@tcp:49:dd.0 Request processed in 120us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857318.124892:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 10 00000100:00100000:3.0:1787857318.125624:0:14314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd94a406d00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14314:1874703885114368:192.168.204.29@tcp:105: 00010000:00010000:3.0:1787857318.125781:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.125792:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c3600/0xf326646fe3bbfdac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125889:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125905:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125943:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125954:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125961:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125966:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125972:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030800 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857318.125975:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125982:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.125994:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857318.125997:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787857318.126001:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126007:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd940030800/0xf326646fe3bbfe5b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126214:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126222:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126233:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126238:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737400 already unused, calling callback (ffffffffc21d84f0) 00010000:00010000:2.0:1787857318.126241:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126247:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126255:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fd982155b00) 00010000:00010000:2.0:1787857318.126258:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787857318.126260:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.126265:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd843737400/0xf326646fe3bbfe4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857318.126602:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d3457722-5072-4545-bc79-4670e7583e8a+18:14491:x1874703863114496:12345-192.168.204.29@tcp:57:lhsmtool_posix.0 Request processed in 20685us (20991us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787857318.126611:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 53 00000020:00080000:2.0:1787857318.126616:0:14314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787857318.127082:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787857318.127087:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857318.127202:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787857318.127209:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787857318.130955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.131151:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115008 00000100:00100000:0.0:1787857318.131161:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115008 00000100:00100000:0.0:1787857318.131217:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 11 00000100:00100000:0.0:1787857318.131228:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+18:14491:x1874703863115008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787857318.131982:0:14317:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787857318.132100:0:14317:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787857318.132145:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132162:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132174:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132182:0:14317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132189:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132195:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.132220:0:14317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787857318.132313:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d3457722-5072-4545-bc79-4670e7583e8a+20:14491:x1874703863115008:12345-192.168.204.29@tcp:35:lhsmtool_posix.0 Request processed in 1086us (1367us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787857318.132322:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 11 00000020:00080000:0.0:1787857318.132327:0:14317:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787857318.132534:0:16427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787857318.132542:0:16427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.132549:0:16427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97c2c2c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857318.132552:0:16427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.132570:0:16427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.132583:0:16427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fd963a5f900) 00010000:00010000:1.0:1787857318.132586:0:16427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787857318.132591:0:16427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.132596:0:16427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fd97c2c2c00/0xf326646fe3bbfe62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14317 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.132608:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857318.132610:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787857318.132611:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787857318.216603:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857318.216630:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885114496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787857318.216748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787857318.216939:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114496 00000100:00100000:0.0:1787857318.216949:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114496 00000100:00100000:0.0:1787857318.217031:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787857318.217042:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885114496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787857318.217080:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787857318.217169:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb49680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874703885114496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787857318.217176:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787857318.217355:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874703885114496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787857318.311226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857318.312191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:1.0:1787857318.312482:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115136 00000100:00100000:1.0:1787857318.312493:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115136 00000100:00100000:1.0:1787857318.312553:0:15003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115264 00000100:00100000:1.0:1787857318.312558:0:15003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115264 00000100:00100000:1.0:1787857318.312580:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1787857318.312589:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd94a406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d3457722-5072-4545-bc79-4670e7583e8a+8:2354:x1874703863115136:12345-192.168.204.29@tcp:4:dd.0 00002000:00010000:1.0:1787857318.312638:0:15003:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9089a5, atime: 0x6a9089a4, ctime: 0x6a9089a5, blocks: 0x1 00010000:00010000:1.0:1787857318.312648:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.312762:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787857318.312768:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.312776:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.312814:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.314242:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.314395:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787857318.314405:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787857318.317813:0:16540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115392 00000100:00100000:1.0:1787857318.317830:0:16540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115392 00000100:00100000:1.0:1787857318.317896:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1787857318.317908:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3457722-5072-4545-bc79-4670e7583e8a+10:2355:x1874703863115264:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1787857318.317958:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.317980:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.317984:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.317992:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.318007:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.332935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857318.335531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:2.0:1787857318.339244:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787857318.345139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.347169:0:15004:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787857318.348971:0:15002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787857318.355612:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115520 00000100:00100000:1.0:1787857318.355636:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115520 00000100:00100000:1.0:1787857318.355730:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787857318.355741:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115648 00000100:00100000:1.0:1787857318.355744:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115648 00000100:00100000:2.0:1787857318.357616:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:2.0:1787857318.357657:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3457722-5072-4545-bc79-4670e7583e8a+13:2355:x1874703863115392:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:2.0:1787857318.357727:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.357747:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857318.357752:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787857318.357759:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.357776:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.359836:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:3.0:1787857318.359971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.29@tcp (source: 12345-192.168.204.29@tcp) 00000100:00100000:0.0:1787857318.376604:0:15004:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1787857318.376743:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787857318.376763:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115776 00000100:00100000:0.0:1787857318.376773:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115776 00000100:00100000:0.0:1787857318.376828:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787857318.376834:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863115904 00000100:00100000:0.0:1787857318.376837:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863115904 00000100:00100000:0.0:1787857318.376852:0:15002:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787857318.376860:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703863116032 00000100:00100000:0.0:1787857318.376863:0:15002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703863116032 00000100:00100000:3.0:1787857318.392152:0:16542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1787857318.392176:0:16542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd945c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d3457722-5072-4545-bc79-4670e7583e8a+19:2355:x1874703863115520:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1787857318.392223:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.392259:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.392264:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.392272:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.392287:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857318.464656:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:2.0:1787857318.464695:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1787857318.464705:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1787857318.464710:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1787857318.464799:0:15003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787857318.464805:0:15003:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1787857318.464820:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464855:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464864:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464871:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857318.464876:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464885:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464906:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.464914:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.465092:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd94a406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d3457722-5072-4545-bc79-4670e7583e8a+21:2354:x1874703863115136:12345-192.168.204.29@tcp:4:dd.0 Request processed in 152499us (153870us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787857318.465103:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 0 00000100:00100000:1.0:1787857318.465136:0:15003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 4 00000100:00100000:1.0:1787857318.465146:0:15003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d3457722-5072-4545-bc79-4670e7583e8a+20:2355:x1874703863115648:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1787857318.465180:0:15003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.465197:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.465202:0:15003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.465208:0:15003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.465220:0:15003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787857318.528088:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:2.0:1787857318.528119:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1787857318.528299:0:16542:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1787857318.528304:0:16542:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:3.0:1787857318.528321:0:16542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528334:0:16542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528342:0:16542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528349:0:16542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843736a00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857318.528354:0:16542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528384:0:16542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528406:0:16542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528414:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000477ce07d/0xf326646fe3bbfe7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.528507:0:16542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd945c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d3457722-5072-4545-bc79-4670e7583e8a+16:2355:x1874703863115520:12345-192.168.204.29@tcp:4:dd.0 Request processed in 136334us (195586us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787857318.528518:0:16542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 3 00000100:00100000:3.0:1787857318.528555:0:16542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 5 00000100:00100000:3.0:1787857318.528567:0:16542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d3457722-5072-4545-bc79-4670e7583e8a+15:2355:x1874703863115776:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1787857318.528598:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528611:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.528616:0:16542:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.528623:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528635:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528808:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528818:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528825:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528830:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd940030800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857318.528833:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528840:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528852:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528859:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b92ba83d/0xf326646fe3bbfe77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.528890:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3457722-5072-4545-bc79-4670e7583e8a+15:2355:x1874703863115392:12345-192.168.204.29@tcp:4:dd.0 Request processed in 171242us (214657us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787857318.528897:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 2 00000100:00100000:3.0:1787857318.528932:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 6 00000100:00100000:3.0:1787857318.528940:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3457722-5072-4545-bc79-4670e7583e8a+14:2355:x1874703863115904:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:3.0:1787857318.528958:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528968:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.528971:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787857318.528975:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.528986:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787857318.546501:0:16540:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:1.0:1787857318.546522:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546536:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546546:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546553:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979800 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857318.546558:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546567:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546590:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546608:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4abb741/0xf326646fe3bbfe70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.546709:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3457722-5072-4545-bc79-4670e7583e8a+16:2355:x1874703863115264:12345-192.168.204.29@tcp:4:dd.0 Request processed in 228799us (234519us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787857318.546720:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 1 00000100:00100000:1.0:1787857318.546758:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.29@tcp, seq: 7 00000100:00100000:1.0:1787857318.546772:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3457722-5072-4545-bc79-4670e7583e8a+15:2355:x1874703863116032:12345-192.168.204.29@tcp:4:dd.0 00010000:00010000:1.0:1787857318.546808:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546822:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.546827:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787857318.546835:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.546849:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787857318.587978:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:0.0:1787857318.588000:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787857318.588118:0:16542:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1787857318.588123:0:16542:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1787857318.588138:0:16542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588152:0:16542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588162:0:16542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588169:0:16542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737600 already unused, calling callback (ffffffffc1788440) 00010000:00010000:3.0:1787857318.588174:0:16542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588203:0:16542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588225:0:16542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787857318.588244:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006751b7fe/0xf326646fe3bbfe8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787857318.588442:0:16542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d3457722-5072-4545-bc79-4670e7583e8a+15:2355:x1874703863115776:12345-192.168.204.29@tcp:4:dd.0 Request processed in 59874us (243309us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787857318.588452:0:16542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 5 00010000:00010000:1.0:1787857318.588534:0:15003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588543:0:15003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588564:0:15003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588570:0:15003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979e00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:1.0:1787857318.588573:0:15003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588581:0:15003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588592:0:15003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787857318.588598:0:15003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054ea51da/0xf326646fe3bbfe85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787857318.588631:0:15003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d3457722-5072-4545-bc79-4670e7583e8a+13:2355:x1874703863115648:12345-192.168.204.29@tcp:4:dd.0 Request processed in 123488us (253111us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787857318.588638:0:15003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 4 00010000:00010000:3.0:1787857318.607111:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787857318.636557:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1787857318.636941:0:16540:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1787857318.636957:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.636969:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.636978:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.636985:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd97f979400 already unused, calling callback (ffffffffc1788440) 00010000:00010000:0.0:1787857318.636990:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.637111:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.637131:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787857318.637139:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009213ce26/0xf326646fe3bbfe9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787857318.637287:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d3457722-5072-4545-bc79-4670e7583e8a+7:2355:x1874703863116032:12345-192.168.204.29@tcp:4:dd.0 Request processed in 90458us (277254us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787857318.637350:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 7 00010000:00010000:2.0:1787857318.638561:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638576:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638584:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638591:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fd843737c00 already unused, calling callback (ffffffffc1788440) 00010000:00010000:2.0:1787857318.638609:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638618:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638633:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787857318.638641:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383a175d/0xf326646fe3bbfe93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787857318.638735:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d3457722-5072-4545-bc79-4670e7583e8a+5:2355:x1874703863115904:12345-192.168.204.29@tcp:4:dd.0 Request processed in 109794us (278906us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787857318.638743:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.29@tcp, seq: 6 00010000:00010000:1.0:1787857319.625091:0:14303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787857319.753978:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787857319.754002:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd97b764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885114624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787857319.754076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857319.754150:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114624 00000100:00100000:1.0:1787857319.754165:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114624 00000100:00100000:1.0:1787857319.754234:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787857319.754244:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885114624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787857319.754278:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787857319.754324:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b7661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874703885114624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857319.754331:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787857319.754353:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787857319.754629:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd97b764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874703885114624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787857319.755883:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885114880:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.755953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857319.756003:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787857319.756010:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885114752:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.756039:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857319.756085:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114752 00000100:00100000:2.0:1787857319.756093:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114752 00000100:00100000:2.0:1787857319.756145:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787857319.756154:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97551b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3312:x1874703885114752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.756213:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97551b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64833f6a-f420-4926-9238-fdfd3153a5b1+19:3312:x1874703885114752:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857319.756221:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787857319.756276:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64833f6a-f420-4926-9238-fdfd3153a5b1:3312:1874703885114752:0@lo:400:kworker.0 00000100:00100000:3.0:1787857319.756449:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885114880 00000100:00100000:3.0:1787857319.756453:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885114880 00000100:00100000:3.0:1787857319.756492:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787857319.756499:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885114880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787857319.756539:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874703885114880:12345-0@lo:400:kworker.0 Request processed in 41us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787857319.756545:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787857319.756568:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787857319.756572:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fd97b765a40, transno 8589934595 00000004:00080000:3.0:1787857319.756582:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787857319.756601:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874703885114880:0@lo:400:kworker.0 00000100:00100000:1.0:1787857319.758315:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885115264:0@lo:400:kworker.0 00000100:00100000:1.0:1787857319.758386:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787857319.758471:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885115264 00000100:00100000:1.0:1787857319.758478:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885115264 00000100:00100000:1.0:1787857319.758534:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787857319.758543:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97b764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885115264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787857319.758601:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97b764b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874703885115264:12345-0@lo:400:kworker.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787857319.758608:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787857319.758630:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787857319.758655:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874703885115264:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.759884:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885115136:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.759946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857319.759987:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787857319.759993:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885115008:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.760010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787857319.760038:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885115136 00000100:00100000:2.0:1787857319.760044:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885115136 00000100:00100000:2.0:1787857319.760081:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874703885115008 00000100:00100000:2.0:1787857319.760084:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874703885115008 00000100:00100000:2.0:1787857319.760095:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857319.760101:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885115136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.760153:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874703885115136:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857319.760160:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787857319.760172:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787857319.760183:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fd97bb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885115008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.760214:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fd97bb483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874703885115008:12345-0@lo:400:kworker.0 Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787857319.760220:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787857319.760234:0:14310:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787857319.760255:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874703885115008:0@lo:400:kworker.0 00000100:00100000:2.0:1787857319.760265:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fd945c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874703885115136:0@lo:400:kworker.0 00000040:00080000:0.0:1787857320.200126:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787857320.200135:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787857320.200169:0:14349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787857320.200176:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:1.0:1787857320.223040:0:16582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787857320.647948:0:16427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787857321.678016:0:14302:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29133 lines, 29133 kept, 0 dropped, 0 bad.